Apr 12 00:23:22 user devstack@n-api.service[72493]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 12 00:23:22 user devstack@n-api.service[72493]: *** Starting uWSGI 2.0.20-debian (64bit) on [Wed Apr 12 00:23:22 2023] *** Apr 12 00:23:22 user devstack@n-api.service[72493]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 12 00:23:22 user devstack@n-api.service[72493]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 12 00:23:22 user devstack@n-api.service[72493]: nodename: user Apr 12 00:23:22 user devstack@n-api.service[72493]: machine: x86_64 Apr 12 00:23:22 user devstack@n-api.service[72493]: clock source: unix Apr 12 00:23:22 user devstack@n-api.service[72493]: pcre jit disabled Apr 12 00:23:22 user devstack@n-api.service[72493]: detected number of CPU cores: 12 Apr 12 00:23:22 user devstack@n-api.service[72493]: current working directory: / Apr 12 00:23:22 user devstack@n-api.service[72493]: detected binary path: /usr/bin/uwsgi-core Apr 12 00:23:22 user devstack@n-api.service[72493]: your processes number limit is 63637 Apr 12 00:23:22 user devstack@n-api.service[72493]: your memory page size is 4096 bytes Apr 12 00:23:22 user devstack@n-api.service[72493]: detected max file descriptor number: 2048 Apr 12 00:23:22 user devstack@n-api.service[72493]: lock engine: pthread robust mutexes Apr 12 00:23:22 user devstack@n-api.service[72493]: thunder lock: enabled Apr 12 00:23:22 user devstack@n-api.service[72493]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 12 00:23:22 user devstack@n-api.service[72493]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 12 00:23:23 user devstack@n-api.service[72493]: Python main interpreter initialized at 0x56256bd0e990 Apr 12 00:23:23 user devstack@n-api.service[72493]: python threads support enabled Apr 12 00:23:23 user devstack@n-api.service[72493]: your server socket listen backlog is limited to 100 connections Apr 12 00:23:23 user devstack@n-api.service[72493]: your mercy for graceful operations on workers is 90 seconds Apr 12 00:23:23 user devstack@n-api.service[72493]: mapped 537436 bytes (524 KB) for 3 cores Apr 12 00:23:23 user devstack@n-api.service[72493]: *** Operational MODE: preforking *** Apr 12 00:23:23 user devstack@n-api.service[72493]: *** uWSGI is running in multiple interpreter mode *** Apr 12 00:23:23 user devstack@n-api.service[72493]: spawned uWSGI master process (pid: 72493) Apr 12 00:23:23 user devstack@n-api.service[72493]: spawned uWSGI worker 1 (pid: 72494, cores: 1) Apr 12 00:23:23 user devstack@n-api.service[72493]: spawned uWSGI worker 2 (pid: 72495, cores: 1) Apr 12 00:23:23 user devstack@n-api.service[72493]: spawned uWSGI worker 3 (pid: 72496, cores: 1) Apr 12 00:23:23 user devstack@n-api.service[72493]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 12 00:23:24 user devstack@n-api.service[72495]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 00:23:24 user devstack@n-api.service[72494]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 00:23:24 user devstack@n-api.service[72496]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 12 00:23:27 user devstack@n-api.service[72494]: live_migration_uri is deprecated for removal in favor of two other options that Apr 12 00:23:27 user devstack@n-api.service[72494]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 12 00:23:27 user devstack@n-api.service[72494]: and ``live_migration_inbound_addr`` respectively. Apr 12 00:23:27 user devstack@n-api.service[72494]: ). Its value may be silently ignored in the future. Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 12 00:23:27 user devstack@n-api.service[72496]: live_migration_uri is deprecated for removal in favor of two other options that Apr 12 00:23:27 user devstack@n-api.service[72496]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 12 00:23:27 user devstack@n-api.service[72496]: and ``live_migration_inbound_addr`` respectively. Apr 12 00:23:27 user devstack@n-api.service[72496]: ). Its value may be silently ignored in the future. Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 12 00:23:27 user devstack@n-api.service[72495]: live_migration_uri is deprecated for removal in favor of two other options that Apr 12 00:23:27 user devstack@n-api.service[72495]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 12 00:23:27 user devstack@n-api.service[72495]: and ``live_migration_inbound_addr`` respectively. Apr 12 00:23:27 user devstack@n-api.service[72495]: ). Its value may be silently ignored in the future. Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72494) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72496) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72495) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 12 00:23:27 user devstack@n-api.service[72494]: INFO dbcounter [None req-2024bd9a-7754-40be-8870-974139307a11 None None] Registered counter for database nova_api Apr 12 00:23:27 user devstack@n-api.service[72496]: INFO dbcounter [None req-a08879a2-3c24-4455-9724-b2183f52a7db None None] Registered counter for database nova_api Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG oslo_db.sqlalchemy.engines [None req-2024bd9a-7754-40be-8870-974139307a11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72494) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writer thread running {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG oslo_db.sqlalchemy.engines [None req-a08879a2-3c24-4455-9724-b2183f52a7db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72496) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writer thread running {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 00:23:27 user devstack@n-api.service[72495]: INFO dbcounter [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] Registered counter for database nova_api Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG nova.context [None req-2024bd9a-7754-40be-8870-974139307a11 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),11a19452-896a-4b9c-be96-3c37d500974d(cell1) {{(pid=72494) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2024bd9a-7754-40be-8870-974139307a11 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2024bd9a-7754-40be-8870-974139307a11 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2024bd9a-7754-40be-8870-974139307a11 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2024bd9a-7754-40be-8870-974139307a11 None None] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2024bd9a-7754-40be-8870-974139307a11 None None] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG oslo_db.sqlalchemy.engines [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72495) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2024bd9a-7754-40be-8870-974139307a11 None None] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:23:27 user devstack@n-api.service[72494]: INFO dbcounter [None req-2024bd9a-7754-40be-8870-974139307a11 None None] Registered counter for database nova_cell0 Apr 12 00:23:27 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writer thread running {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 00:23:27 user devstack@n-api.service[72494]: INFO dbcounter [None req-2024bd9a-7754-40be-8870-974139307a11 None None] Registered counter for database nova_cell1 Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG nova.context [None req-a08879a2-3c24-4455-9724-b2183f52a7db None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),11a19452-896a-4b9c-be96-3c37d500974d(cell1) {{(pid=72496) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a08879a2-3c24-4455-9724-b2183f52a7db None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a08879a2-3c24-4455-9724-b2183f52a7db None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG oslo_db.sqlalchemy.engines [None req-2024bd9a-7754-40be-8870-974139307a11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72494) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a08879a2-3c24-4455-9724-b2183f52a7db None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a08879a2-3c24-4455-9724-b2183f52a7db None None] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG oslo_db.sqlalchemy.engines [None req-2024bd9a-7754-40be-8870-974139307a11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72494) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a08879a2-3c24-4455-9724-b2183f52a7db None None] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a08879a2-3c24-4455-9724-b2183f52a7db None None] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:23:27 user devstack@n-api.service[72496]: INFO dbcounter [None req-a08879a2-3c24-4455-9724-b2183f52a7db None None] Registered counter for database nova_cell0 Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writer thread running {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 00:23:27 user devstack@n-api.service[72496]: INFO dbcounter [None req-a08879a2-3c24-4455-9724-b2183f52a7db None None] Registered counter for database nova_cell1 Apr 12 00:23:27 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writer thread running {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG oslo_db.sqlalchemy.engines [None req-a08879a2-3c24-4455-9724-b2183f52a7db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72496) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 00:23:27 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writer thread running {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 00:23:28 user devstack@n-api.service[72496]: DEBUG oslo_db.sqlalchemy.engines [None req-a08879a2-3c24-4455-9724-b2183f52a7db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72496) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 00:23:28 user devstack@n-api.service[72495]: DEBUG nova.context [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),11a19452-896a-4b9c-be96-3c37d500974d(cell1) {{(pid=72495) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 00:23:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:23:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:23:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:23:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:23:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:23:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:23:28 user devstack@n-api.service[72495]: INFO dbcounter [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] Registered counter for database nova_cell0 Apr 12 00:23:28 user devstack@n-api.service[72495]: INFO dbcounter [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] Registered counter for database nova_cell1 Apr 12 00:23:28 user devstack@n-api.service[72495]: DEBUG oslo_db.sqlalchemy.engines [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72495) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 00:23:28 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writer thread running {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 00:23:28 user devstack@n-api.service[72495]: DEBUG oslo_db.sqlalchemy.engines [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72495) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 00:23:28 user devstack@n-api.service[72494]: INFO dbcounter [None req-2024bd9a-7754-40be-8870-974139307a11 None None] Registered counter for database nova_cell0 Apr 12 00:23:28 user devstack@n-api.service[72494]: DEBUG oslo_db.sqlalchemy.engines [None req-2024bd9a-7754-40be-8870-974139307a11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72494) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 00:23:28 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writer thread running {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 00:23:28 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writer thread running {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 00:23:28 user devstack@n-api.service[72496]: INFO dbcounter [None req-a08879a2-3c24-4455-9724-b2183f52a7db None None] Registered counter for database nova_cell0 Apr 12 00:23:28 user devstack@n-api.service[72496]: DEBUG oslo_db.sqlalchemy.engines [None req-a08879a2-3c24-4455-9724-b2183f52a7db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72496) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 00:23:28 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writer thread running {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 00:23:28 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writer thread running {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 00:23:28 user devstack@n-api.service[72495]: INFO dbcounter [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] Registered counter for database nova_cell0 Apr 12 00:23:28 user devstack@n-api.service[72495]: DEBUG oslo_db.sqlalchemy.engines [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72495) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 00:23:28 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writer thread running {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 00:23:28 user devstack@n-api.service[72494]: WARNING keystonemiddleware.auth_token [None req-2024bd9a-7754-40be-8870-974139307a11 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 00:23:28 user devstack@n-api.service[72494]: WARNING keystonemiddleware.auth_token [None req-2024bd9a-7754-40be-8870-974139307a11 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 00:23:28 user devstack@n-api.service[72496]: WARNING keystonemiddleware.auth_token [None req-a08879a2-3c24-4455-9724-b2183f52a7db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 00:23:28 user devstack@n-api.service[72496]: WARNING keystonemiddleware.auth_token [None req-a08879a2-3c24-4455-9724-b2183f52a7db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 00:23:28 user devstack@n-api.service[72495]: WARNING keystonemiddleware.auth_token [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 00:23:28 user devstack@n-api.service[72495]: WARNING keystonemiddleware.auth_token [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 00:23:28 user devstack@n-api.service[72494]: WARNING keystonemiddleware.auth_token [None req-2024bd9a-7754-40be-8870-974139307a11 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 00:23:28 user devstack@n-api.service[72494]: WARNING keystonemiddleware.auth_token [None req-2024bd9a-7754-40be-8870-974139307a11 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 00:23:28 user devstack@n-api.service[72494]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56256bd0e990 pid: 72494 (default app) Apr 12 00:23:28 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-2024bd9a-7754-40be-8870-974139307a11 None None] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:23:28 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-2024bd9a-7754-40be-8870-974139307a11 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001472 Apr 12 00:23:28 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Wed Apr 12 00:23:28 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:23:28 user devstack@n-api.service[72496]: WARNING keystonemiddleware.auth_token [None req-a08879a2-3c24-4455-9724-b2183f52a7db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 00:23:28 user devstack@n-api.service[72496]: WARNING keystonemiddleware.auth_token [None req-a08879a2-3c24-4455-9724-b2183f52a7db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 00:23:28 user devstack@n-api.service[72496]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56256bd0e990 pid: 72496 (default app) Apr 12 00:23:28 user devstack@n-api.service[72495]: WARNING keystonemiddleware.auth_token [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 00:23:28 user devstack@n-api.service[72495]: WARNING keystonemiddleware.auth_token [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 00:23:28 user devstack@n-api.service[72495]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56256bd0e990 pid: 72495 (default app) Apr 12 00:25:39 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-2024bd9a-7754-40be-8870-974139307a11 None None] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:39 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-2024bd9a-7754-40be-8870-974139307a11 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001454 Apr 12 00:25:39 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 00:25:39 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:25:39 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=3 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:25:39 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=3 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:25:39 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=3 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:25:39 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=3 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:25:40 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-8545780b-279a-4273-94ca-c177076458e6 admin admin] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:40 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-8545780b-279a-4273-94ca-c177076458e6 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.383564 Apr 12 00:25:40 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 12 00:25:39 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:25:42 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:42 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002833 Apr 12 00:25:42 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 00:25:42 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:25:42 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=3 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:25:42 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=3 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:25:42 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=3 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:25:42 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:25:42 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-ddc7fce9-4b6d-4a98-b86d-7c1823f2f0e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "rxtx_factor": 1.0, "vcpus": 1, "id": "c1", "os-flavor-access:is_public": true, "disk": 1, "ram": 256, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:25:42 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-ddc7fce9-4b6d-4a98-b86d-7c1823f2f0e3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.308100 Apr 12 00:25:42 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 00:25:42 2023] POST /compute/v2.1/flavors => generated 405 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:25:42 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-e8a33cc2-ba9d-4afc-b0a0-36cc857cc78a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:25:42 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-e8a33cc2-ba9d-4afc-b0a0-36cc857cc78a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.057863 Apr 12 00:25:42 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 00:25:42 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:25:44 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:44 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001354 Apr 12 00:25:44 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 00:25:44 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:25:44 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-511bc275-d320-4c6b-916a-5bedce255d2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "name": "ds512M", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:25:44 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-511bc275-d320-4c6b-916a-5bedce255d2d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.066343 Apr 12 00:25:44 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 00:25:44 2023] POST /compute/v2.1/flavors => generated 402 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:25:44 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-cae5a27c-44c3-4232-b3f4-aeed6240a4c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:25:44 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-cae5a27c-44c3-4232-b3f4-aeed6240a4c2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030953 Apr 12 00:25:44 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 00:25:44 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:25:46 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:46 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001411 Apr 12 00:25:46 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 00:25:46 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:25:46 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-88d76180-5290-4321-8f73-bfca214a2045 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 1024, "disk": 10, "vcpus": 1, "id": "d2", "name": "ds1G"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:25:46 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-88d76180-5290-4321-8f73-bfca214a2045 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.062253 Apr 12 00:25:46 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 00:25:46 2023] POST /compute/v2.1/flavors => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:25:46 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-c13fa4ba-cd31-4bbd-b4d5-fcaab79f52d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:25:46 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-c13fa4ba-cd31-4bbd-b4d5-fcaab79f52d8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027184 Apr 12 00:25:46 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 00:25:46 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:25:48 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:48 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001384 Apr 12 00:25:48 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 00:25:48 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:25:48 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-a977c09b-e282-4f50-bec6-4a47b083767b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "name": "ds2G", "vcpus": 2}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:25:48 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-a977c09b-e282-4f50-bec6-4a47b083767b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.061071 Apr 12 00:25:48 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 00:25:48 2023] POST /compute/v2.1/flavors => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:25:48 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-1c1c8998-cf3a-42a1-b37a-da15b20597b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:25:48 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-1c1c8998-cf3a-42a1-b37a-da15b20597b5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026481 Apr 12 00:25:48 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 00:25:48 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:25:50 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:50 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001368 Apr 12 00:25:50 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 00:25:50 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:25:50 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-2beb912d-05bf-4c38-b423-fda89e632eec admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 4, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:25:50 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-2beb912d-05bf-4c38-b423-fda89e632eec admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.055026 Apr 12 00:25:50 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 00:25:50 2023] POST /compute/v2.1/flavors => generated 402 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:25:50 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-67cc9dfb-a395-4dfa-8cb7-c8c8398f8669 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:25:50 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-67cc9dfb-a395-4dfa-8cb7-c8c8398f8669 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024683 Apr 12 00:25:50 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 00:25:50 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:25:52 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:52 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-7e4ea0ea-d72e-4dfa-9b05-8b206c8a98d3 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001278 Apr 12 00:25:52 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 00:25:52 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:25:52 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-6d0a55c6-930d-4906-9b9e-c17dc3de8a85 admin admin] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:52 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-6d0a55c6-930d-4906-9b9e-c17dc3de8a85 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.074592 Apr 12 00:25:52 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 12 00:25:52 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:25:54 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-67cc9dfb-a395-4dfa-8cb7-c8c8398f8669 admin admin] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:54 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-67cc9dfb-a395-4dfa-8cb7-c8c8398f8669 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001773 Apr 12 00:25:54 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 00:25:54 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:25:54 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=3 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:25:54 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=3 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:25:54 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=3 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:25:54 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=3 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:25:54 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-c08c0dee-104c-4c2c-ac61-ab17a047eb09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "swap": 0, "vcpus": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:25:54 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-c08c0dee-104c-4c2c-ac61-ab17a047eb09 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.342990 Apr 12 00:25:54 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 00:25:54 2023] POST /compute/v2.1/flavors => generated 400 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:25:54 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-a79de135-ee82-4991-b259-0115b58cc7e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:25:55 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-a79de135-ee82-4991-b259-0115b58cc7e0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045052 Apr 12 00:25:55 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 00:25:54 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:25:56 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-67cc9dfb-a395-4dfa-8cb7-c8c8398f8669 admin admin] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:56 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-67cc9dfb-a395-4dfa-8cb7-c8c8398f8669 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001547 Apr 12 00:25:56 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 00:25:56 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:25:56 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-bb3d7524-9546-4332-8375-accc7fc40cc4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "ram": 2048, "disk": 20, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "2"}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:25:56 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-bb3d7524-9546-4332-8375-accc7fc40cc4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.056397 Apr 12 00:25:56 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 00:25:56 2023] POST /compute/v2.1/flavors => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:25:57 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-8ea87949-af73-44a4-9fca-1b71c557c6cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:25:57 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-8ea87949-af73-44a4-9fca-1b71c557c6cb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031574 Apr 12 00:25:57 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 00:25:56 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:25:58 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-67cc9dfb-a395-4dfa-8cb7-c8c8398f8669 admin admin] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:25:58 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-67cc9dfb-a395-4dfa-8cb7-c8c8398f8669 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001551 Apr 12 00:25:58 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 00:25:58 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:25:59 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-0818a9d7-60c2-4eea-ae11-2d71ba6827cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "m1.medium", "ram": 4096, "disk": 40, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:25:59 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-0818a9d7-60c2-4eea-ae11-2d71ba6827cc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.061211 Apr 12 00:25:59 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 00:25:58 2023] POST /compute/v2.1/flavors => generated 404 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:25:59 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-f2351265-f464-44f2-9fca-0508d25eae7a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:25:59 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-f2351265-f464-44f2-9fca-0508d25eae7a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025242 Apr 12 00:25:59 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 00:25:59 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:00 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-67cc9dfb-a395-4dfa-8cb7-c8c8398f8669 admin admin] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:00 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-67cc9dfb-a395-4dfa-8cb7-c8c8398f8669 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001588 Apr 12 00:26:00 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 00:26:00 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:26:00 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-e00bf450-c66a-4bd0-b111-3ac74943f310 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "name": "m1.large"}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:26:01 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-e00bf450-c66a-4bd0-b111-3ac74943f310 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.076098 Apr 12 00:26:01 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 00:26:00 2023] POST /compute/v2.1/flavors => generated 403 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:26:01 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-c6eb9f92-a185-4987-9d9d-1cef9194c477 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:26:01 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-c6eb9f92-a185-4987-9d9d-1cef9194c477 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029516 Apr 12 00:26:01 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 00:26:01 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:03 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-67cc9dfb-a395-4dfa-8cb7-c8c8398f8669 admin admin] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:03 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-67cc9dfb-a395-4dfa-8cb7-c8c8398f8669 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001639 Apr 12 00:26:03 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 00:26:03 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:26:03 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-01bcb207-fd07-44d5-8e01-053a4bc18f95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "id": "5", "swap": 0, "disk": 160, "vcpus": 8, "os-flavor-access:is_public": true, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:26:03 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-01bcb207-fd07-44d5-8e01-053a4bc18f95 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.061620 Apr 12 00:26:03 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 00:26:03 2023] POST /compute/v2.1/flavors => generated 406 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:26:03 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-714d328b-c939-46c9-98d7-7b0b4d57732d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:26:03 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-714d328b-c939-46c9-98d7-7b0b4d57732d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026326 Apr 12 00:26:03 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 00:26:03 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:26:34 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-67cc9dfb-a395-4dfa-8cb7-c8c8398f8669 admin admin] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:34 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-67cc9dfb-a395-4dfa-8cb7-c8c8398f8669 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002088 Apr 12 00:26:34 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 00:26:34 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:26:34 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:26:34 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-437687fe-0d52-4ada-8048-8ee40ecdb6f5 admin admin] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:26:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-437687fe-0d52-4ada-8048-8ee40ecdb6f5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:26:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-437687fe-0d52-4ada-8048-8ee40ecdb6f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:26:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-437687fe-0d52-4ada-8048-8ee40ecdb6f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:26:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-437687fe-0d52-4ada-8048-8ee40ecdb6f5 admin admin] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:26:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-437687fe-0d52-4ada-8048-8ee40ecdb6f5 admin admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:26:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-437687fe-0d52-4ada-8048-8ee40ecdb6f5 admin admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:26:34 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-437687fe-0d52-4ada-8048-8ee40ecdb6f5 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.088632 Apr 12 00:26:34 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Wed Apr 12 00:26:34 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:27:06 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-714d328b-c939-46c9-98d7-7b0b4d57732d admin admin] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:06 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-714d328b-c939-46c9-98d7-7b0b4d57732d admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001388 Apr 12 00:27:06 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 00:27:06 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:27:06 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:27:06 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-e6ebcd4a-f87c-4223-b6ef-c698b3ea4e27 admin admin] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:06 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-e6ebcd4a-f87c-4223-b6ef-c698b3ea4e27 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.070570 Apr 12 00:27:06 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Wed Apr 12 00:27:06 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:27:11 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-437687fe-0d52-4ada-8048-8ee40ecdb6f5 admin admin] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:11 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-437687fe-0d52-4ada-8048-8ee40ecdb6f5 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001602 Apr 12 00:27:11 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 00:27:11 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:27:11 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:27:11 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-82005aad-f74d-424e-93f9-a423b622eab7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "name": "m1.nano", "rxtx_factor": 1.0, "id": "42", "ram": 128}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:27:11 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-82005aad-f74d-424e-93f9-a423b622eab7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.067371 Apr 12 00:27:11 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 12 00:27:11 2023] POST /compute/v2.1/flavors => generated 403 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:27:11 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-512db58a-5c91-4f84-9e93-380586f0a468 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:27:11 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-512db58a-5c91-4f84-9e93-380586f0a468 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028871 Apr 12 00:27:11 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 12 00:27:11 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:27:15 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-437687fe-0d52-4ada-8048-8ee40ecdb6f5 admin admin] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:27:15 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-437687fe-0d52-4ada-8048-8ee40ecdb6f5 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001380 Apr 12 00:27:15 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 00:27:15 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:27:15 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-64bd5558-3931-4e45-9e88-182daa33bfa6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 192, "name": "m1.micro", "id": "84", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:27:15 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-64bd5558-3931-4e45-9e88-182daa33bfa6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.061690 Apr 12 00:27:15 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 12 00:27:15 2023] POST /compute/v2.1/flavors => generated 404 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:27:15 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-960c6a89-d8fd-4bf3-bfc8-c3f44c041d27 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:27:15 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-960c6a89-d8fd-4bf3-bfc8-c3f44c041d27 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025913 Apr 12 00:27:15 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 12 00:27:15 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:27 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:29:27 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:29:27 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:29:27 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:29:28 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-bc9fa069-b382-4025-b1a0-f2726757bb38 tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] Action: 'create', calling method: .version_select at 0x7f7cd5666a70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1882188694", "metadata": {"Type": "work"}}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:28 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-bc9fa069-b382-4025-b1a0-f2726757bb38 tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] Request method failure captured: Apr 12 00:29:28 user devstack@n-api.service[72495]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 12 00:29:28 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:29:28 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:29:28 user devstack@n-api.service[72495]: Connection: close Apr 12 00:29:28 user devstack@n-api.service[72495]: Content-Length: 122 Apr 12 00:29:28 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:29:28 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:29:28 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:29:28 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNftn0Uj4_zj2IyG58GBO8EuPbTXd8AiZwCLiaNH3e65P-V0CCx71TpG-EN-CECLnmEWT1lRziwBrZMnoK1eXoWi7LEk1wMUi9TFYNL86PWWe7QDn9VH0SaD3ThuV63yclw77Q62D8HE4yAHdaoINFXAtxhW1iQXeaC90JyF6RpmAS48 Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Project-Id: 980f69952cca4ad7a69415698b67f1c3 Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Project-Name: tempest-VolumesNegativeTest-1247910315 Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980f69952cca4ad7a69415698b67f1c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/980f69952cca4ad7a69415698b67f1c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980f69952cca4ad7a69415698b67f1c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Tenant: tempest-VolumesNegativeTest-1247910315 Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Tenant-Id: 980f69952cca4ad7a69415698b67f1c3 Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-VolumesNegativeTest-1247910315 Apr 12 00:29:28 user devstack@n-api.service[72495]: X-User: tempest-VolumesNegativeTest-1247910315-project-member Apr 12 00:29:28 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:29:28 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:29:28 user devstack@n-api.service[72495]: X-User-Id: 8621901177df4673b48c84a439544d12 Apr 12 00:29:28 user devstack@n-api.service[72495]: X-User-Name: tempest-VolumesNegativeTest-1247910315-project-member Apr 12 00:29:28 user devstack@n-api.service[72495]: Apr 12 00:29:28 user devstack@n-api.service[72495]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1882188694", "metadata": {"Type": "work"}}} Apr 12 00:29:28 user devstack@n-api.service[72495]: method: Apr 12 00:29:28 user devstack@n-api.service[72495]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 12 00:29:28 user devstack@n-api.service[72495]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1882188694', 'metadata': {'Type': 'work'}}}} Apr 12 00:29:28 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise error Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi '#$%' Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:29:28 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-bc9fa069-b382-4025-b1a0-f2726757bb38 tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:29:28 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-bc9fa069-b382-4025-b1a0-f2726757bb38 tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.478771 Apr 12 00:29:28 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 00:29:27 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 480 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:29:28 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:29:28 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-049f8b93-4ee5-4861-9461-f7eeabc7df4c tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] Action: 'create', calling method: .version_select at 0x7f7cd563e200>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1350771737", "metadata": {"Type": "work"}}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:28 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-049f8b93-4ee5-4861-9461-f7eeabc7df4c tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] Request method failure captured: Apr 12 00:29:28 user devstack@n-api.service[72496]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 12 00:29:28 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:29:28 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:29:28 user devstack@n-api.service[72496]: Connection: close Apr 12 00:29:28 user devstack@n-api.service[72496]: Content-Length: 120 Apr 12 00:29:28 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:29:28 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:29:28 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:29:28 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:29:28 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNftn0Uj4_zj2IyG58GBO8EuPbTXd8AiZwCLiaNH3e65P-V0CCx71TpG-EN-CECLnmEWT1lRziwBrZMnoK1eXoWi7LEk1wMUi9TFYNL86PWWe7QDn9VH0SaD3ThuV63yclw77Q62D8HE4yAHdaoINFXAtxhW1iQXeaC90JyF6RpmAS48 Apr 12 00:29:28 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:29:28 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:29:28 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:29:28 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:29:28 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:29:28 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:29:28 user devstack@n-api.service[72496]: X-Project-Id: 980f69952cca4ad7a69415698b67f1c3 Apr 12 00:29:28 user devstack@n-api.service[72496]: X-Project-Name: tempest-VolumesNegativeTest-1247910315 Apr 12 00:29:28 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:29:28 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:29:28 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980f69952cca4ad7a69415698b67f1c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/980f69952cca4ad7a69415698b67f1c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980f69952cca4ad7a69415698b67f1c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:29:28 user devstack@n-api.service[72496]: X-Tenant: tempest-VolumesNegativeTest-1247910315 Apr 12 00:29:28 user devstack@n-api.service[72496]: X-Tenant-Id: 980f69952cca4ad7a69415698b67f1c3 Apr 12 00:29:28 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-VolumesNegativeTest-1247910315 Apr 12 00:29:28 user devstack@n-api.service[72496]: X-User: tempest-VolumesNegativeTest-1247910315-project-member Apr 12 00:29:28 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:29:28 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:29:28 user devstack@n-api.service[72496]: X-User-Id: 8621901177df4673b48c84a439544d12 Apr 12 00:29:28 user devstack@n-api.service[72496]: X-User-Name: tempest-VolumesNegativeTest-1247910315-project-member Apr 12 00:29:28 user devstack@n-api.service[72496]: Apr 12 00:29:28 user devstack@n-api.service[72496]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1350771737", "metadata": {"Type": "work"}}} Apr 12 00:29:28 user devstack@n-api.service[72496]: method: Apr 12 00:29:28 user devstack@n-api.service[72496]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 12 00:29:28 user devstack@n-api.service[72496]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1350771737', 'metadata': {'Type': 'work'}}}} Apr 12 00:29:28 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise error Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi '0' Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 12 00:29:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:28 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-049f8b93-4ee5-4861-9461-f7eeabc7df4c tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:29:28 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-049f8b93-4ee5-4861-9461-f7eeabc7df4c tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.024956 Apr 12 00:29:28 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 16/47] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 00:29:28 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:29:28 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-4008d384-73f9-48a6-87c7-bb52b590081a tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] Action: 'create', calling method: .version_select at 0x7f7cd607d120>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1822601878", "metadata": {"Type": "work"}}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:28 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-4008d384-73f9-48a6-87c7-bb52b590081a tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] Request method failure captured: Apr 12 00:29:28 user devstack@n-api.service[72495]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 12 00:29:28 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:29:28 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:29:28 user devstack@n-api.service[72495]: Connection: close Apr 12 00:29:28 user devstack@n-api.service[72495]: Content-Length: 119 Apr 12 00:29:28 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:29:28 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:29:28 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:29:28 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNftn0Uj4_zj2IyG58GBO8EuPbTXd8AiZwCLiaNH3e65P-V0CCx71TpG-EN-CECLnmEWT1lRziwBrZMnoK1eXoWi7LEk1wMUi9TFYNL86PWWe7QDn9VH0SaD3ThuV63yclw77Q62D8HE4yAHdaoINFXAtxhW1iQXeaC90JyF6RpmAS48 Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Project-Id: 980f69952cca4ad7a69415698b67f1c3 Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Project-Name: tempest-VolumesNegativeTest-1247910315 Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980f69952cca4ad7a69415698b67f1c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/980f69952cca4ad7a69415698b67f1c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980f69952cca4ad7a69415698b67f1c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Tenant: tempest-VolumesNegativeTest-1247910315 Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Tenant-Id: 980f69952cca4ad7a69415698b67f1c3 Apr 12 00:29:28 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-VolumesNegativeTest-1247910315 Apr 12 00:29:28 user devstack@n-api.service[72495]: X-User: tempest-VolumesNegativeTest-1247910315-project-member Apr 12 00:29:28 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:29:28 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:29:28 user devstack@n-api.service[72495]: X-User-Id: 8621901177df4673b48c84a439544d12 Apr 12 00:29:28 user devstack@n-api.service[72495]: X-User-Name: tempest-VolumesNegativeTest-1247910315-project-member Apr 12 00:29:28 user devstack@n-api.service[72495]: Apr 12 00:29:28 user devstack@n-api.service[72495]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1822601878", "metadata": {"Type": "work"}}} Apr 12 00:29:28 user devstack@n-api.service[72495]: method: Apr 12 00:29:28 user devstack@n-api.service[72495]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 12 00:29:28 user devstack@n-api.service[72495]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1822601878', 'metadata': {'Type': 'work'}}}} Apr 12 00:29:28 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise error Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi '' Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 12 00:29:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:29:28 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-4008d384-73f9-48a6-87c7-bb52b590081a tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:29:28 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-4008d384-73f9-48a6-87c7-bb52b590081a tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009370 Apr 12 00:29:28 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 16/48] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 00:29:28 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:29:28 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-e0bb0e26-ca4c-4fbe-9489-845f251d5282 tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] Calling method '.version_select at 0x7f7cd607d090>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:28 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-d2e09eaf-678a-4777-8caf-019743837301 tempest-VolumesGetTestJSON-1197798425 tempest-VolumesGetTestJSON-1197798425-project-member] Action: 'create', calling method: .version_select at 0x7f7cd5667490>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-521045111", "metadata": {"Type": "work"}}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:29 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-e0bb0e26-ca4c-4fbe-9489-845f251d5282 tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] HTTP exception thrown: Volume tempest-invalid-1046019577 could not be found. Apr 12 00:29:29 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-e0bb0e26-ca4c-4fbe-9489-845f251d5282 tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] Request method failure captured: Apr 12 00:29:29 user devstack@n-api.service[72496]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1046019577 HTTP/1.1 Apr 12 00:29:29 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:29:29 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:29:29 user devstack@n-api.service[72496]: Connection: close Apr 12 00:29:29 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:29:29 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:29:29 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:29:29 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:29:29 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNftn0Uj4_zj2IyG58GBO8EuPbTXd8AiZwCLiaNH3e65P-V0CCx71TpG-EN-CECLnmEWT1lRziwBrZMnoK1eXoWi7LEk1wMUi9TFYNL86PWWe7QDn9VH0SaD3ThuV63yclw77Q62D8HE4yAHdaoINFXAtxhW1iQXeaC90JyF6RpmAS48 Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Project-Id: 980f69952cca4ad7a69415698b67f1c3 Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Project-Name: tempest-VolumesNegativeTest-1247910315 Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980f69952cca4ad7a69415698b67f1c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/980f69952cca4ad7a69415698b67f1c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980f69952cca4ad7a69415698b67f1c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Tenant: tempest-VolumesNegativeTest-1247910315 Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Tenant-Id: 980f69952cca4ad7a69415698b67f1c3 Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-VolumesNegativeTest-1247910315 Apr 12 00:29:29 user devstack@n-api.service[72496]: X-User: tempest-VolumesNegativeTest-1247910315-project-member Apr 12 00:29:29 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:29:29 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:29:29 user devstack@n-api.service[72496]: X-User-Id: 8621901177df4673b48c84a439544d12 Apr 12 00:29:29 user devstack@n-api.service[72496]: X-User-Name: tempest-VolumesNegativeTest-1247910315-project-member Apr 12 00:29:29 user devstack@n-api.service[72496]: method: Apr 12 00:29:29 user devstack@n-api.service[72496]: exception: Volume tempest-invalid-1046019577 could not be found. Apr 12 00:29:29 user devstack@n-api.service[72496]: action_args: {'id': 'tempest-invalid-1046019577'} Apr 12 00:29:29 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1046019577 could not be found. (HTTP 404) (Request-ID: req-34fcea55-59b4-4285-addb-c32e0d5e8344) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1046019577 could not be found. Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1046019577 could not be found. Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1046019577 could not be found. Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:29 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-e0bb0e26-ca4c-4fbe-9489-845f251d5282 tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] Returning 404 to user: Volume tempest-invalid-1046019577 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:29:29 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-e0bb0e26-ca4c-4fbe-9489-845f251d5282 tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1046019577" status: 404 len: 99 microversion: 2.1 time: 0.916190 Apr 12 00:29:29 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 17/49] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 00:29:28 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1046019577 => generated 99 bytes in 917 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 12 00:29:29 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-7f04aeae-c20a-445a-9feb-c72e5ecc0a43 tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003391 Apr 12 00:29:29 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 17/50] 10.0.0.210 () {62 vars in 1217 bytes} [Wed Apr 12 00:29:29 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 12 00:29:29 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-485e83e8-3dba-43a4-a6f0-c6e034c03455 tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004216 Apr 12 00:29:29 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 18/51] 10.0.0.210 () {62 vars in 1214 bytes} [Wed Apr 12 00:29:29 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 12 00:29:29 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-2153d6de-be9d-47ee-9f81-1559e138e0c2 tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] Calling method '.version_select at 0x7f7cd56dc4c0>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:29 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-2153d6de-be9d-47ee-9f81-1559e138e0c2 tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] HTTP exception thrown: Volume 2ea5abc8-1705-4c4d-8e31-78b62d6455b1 could not be found. Apr 12 00:29:29 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-2153d6de-be9d-47ee-9f81-1559e138e0c2 tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] Request method failure captured: Apr 12 00:29:29 user devstack@n-api.service[72495]: request: DELETE /compute/v2.1/os-volumes/2ea5abc8-1705-4c4d-8e31-78b62d6455b1 HTTP/1.1 Apr 12 00:29:29 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:29:29 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:29:29 user devstack@n-api.service[72495]: Connection: close Apr 12 00:29:29 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 00:29:29 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:29:29 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:29:29 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:29:29 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:29:29 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNftn0Uj4_zj2IyG58GBO8EuPbTXd8AiZwCLiaNH3e65P-V0CCx71TpG-EN-CECLnmEWT1lRziwBrZMnoK1eXoWi7LEk1wMUi9TFYNL86PWWe7QDn9VH0SaD3ThuV63yclw77Q62D8HE4yAHdaoINFXAtxhW1iQXeaC90JyF6RpmAS48 Apr 12 00:29:29 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:29:29 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:29:29 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:29:29 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:29:29 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:29:29 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:29:29 user devstack@n-api.service[72495]: X-Project-Id: 980f69952cca4ad7a69415698b67f1c3 Apr 12 00:29:29 user devstack@n-api.service[72495]: X-Project-Name: tempest-VolumesNegativeTest-1247910315 Apr 12 00:29:29 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:29:29 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:29:29 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980f69952cca4ad7a69415698b67f1c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/980f69952cca4ad7a69415698b67f1c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980f69952cca4ad7a69415698b67f1c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:29:29 user devstack@n-api.service[72495]: X-Tenant: tempest-VolumesNegativeTest-1247910315 Apr 12 00:29:29 user devstack@n-api.service[72495]: X-Tenant-Id: 980f69952cca4ad7a69415698b67f1c3 Apr 12 00:29:29 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-VolumesNegativeTest-1247910315 Apr 12 00:29:29 user devstack@n-api.service[72495]: X-User: tempest-VolumesNegativeTest-1247910315-project-member Apr 12 00:29:29 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:29:29 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:29:29 user devstack@n-api.service[72495]: X-User-Id: 8621901177df4673b48c84a439544d12 Apr 12 00:29:29 user devstack@n-api.service[72495]: X-User-Name: tempest-VolumesNegativeTest-1247910315-project-member Apr 12 00:29:29 user devstack@n-api.service[72495]: method: Apr 12 00:29:29 user devstack@n-api.service[72495]: exception: Volume 2ea5abc8-1705-4c4d-8e31-78b62d6455b1 could not be found. Apr 12 00:29:29 user devstack@n-api.service[72495]: action_args: {'id': '2ea5abc8-1705-4c4d-8e31-78b62d6455b1'} Apr 12 00:29:29 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ea5abc8-1705-4c4d-8e31-78b62d6455b1 could not be found. (HTTP 404) (Request-ID: req-71fbf6bb-f8fe-47f7-8295-ffad9d27b3b8) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ea5abc8-1705-4c4d-8e31-78b62d6455b1 could not be found. Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ea5abc8-1705-4c4d-8e31-78b62d6455b1 could not be found. Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ea5abc8-1705-4c4d-8e31-78b62d6455b1 could not be found. Apr 12 00:29:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:29:29 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-2153d6de-be9d-47ee-9f81-1559e138e0c2 tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] Returning 404 to user: Volume 2ea5abc8-1705-4c4d-8e31-78b62d6455b1 could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:29:29 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-2153d6de-be9d-47ee-9f81-1559e138e0c2 tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/2ea5abc8-1705-4c4d-8e31-78b62d6455b1" status: 404 len: 109 microversion: 2.1 time: 0.274047 Apr 12 00:29:29 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 18/52] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 00:29:29 2023] DELETE /compute/v2.1/os-volumes/2ea5abc8-1705-4c4d-8e31-78b62d6455b1 => generated 109 bytes in 275 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:29:29 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-b7ab883a-0728-461d-9d3a-0c16de516d45 tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] Calling method '.version_select at 0x7f7cd5558d30>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:29 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-b7ab883a-0728-461d-9d3a-0c16de516d45 tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] HTTP exception thrown: Volume bf2a00fd-4db6-4f32-85ad-623308dd8301 could not be found. Apr 12 00:29:29 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-b7ab883a-0728-461d-9d3a-0c16de516d45 tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] Request method failure captured: Apr 12 00:29:29 user devstack@n-api.service[72496]: request: GET /compute/v2.1/os-volumes/bf2a00fd-4db6-4f32-85ad-623308dd8301 HTTP/1.1 Apr 12 00:29:29 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:29:29 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:29:29 user devstack@n-api.service[72496]: Connection: close Apr 12 00:29:29 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:29:29 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:29:29 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:29:29 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:29:29 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNftn0Uj4_zj2IyG58GBO8EuPbTXd8AiZwCLiaNH3e65P-V0CCx71TpG-EN-CECLnmEWT1lRziwBrZMnoK1eXoWi7LEk1wMUi9TFYNL86PWWe7QDn9VH0SaD3ThuV63yclw77Q62D8HE4yAHdaoINFXAtxhW1iQXeaC90JyF6RpmAS48 Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Project-Id: 980f69952cca4ad7a69415698b67f1c3 Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Project-Name: tempest-VolumesNegativeTest-1247910315 Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980f69952cca4ad7a69415698b67f1c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/980f69952cca4ad7a69415698b67f1c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/980f69952cca4ad7a69415698b67f1c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Tenant: tempest-VolumesNegativeTest-1247910315 Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Tenant-Id: 980f69952cca4ad7a69415698b67f1c3 Apr 12 00:29:29 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-VolumesNegativeTest-1247910315 Apr 12 00:29:29 user devstack@n-api.service[72496]: X-User: tempest-VolumesNegativeTest-1247910315-project-member Apr 12 00:29:29 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:29:29 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:29:29 user devstack@n-api.service[72496]: X-User-Id: 8621901177df4673b48c84a439544d12 Apr 12 00:29:29 user devstack@n-api.service[72496]: X-User-Name: tempest-VolumesNegativeTest-1247910315-project-member Apr 12 00:29:29 user devstack@n-api.service[72496]: method: Apr 12 00:29:29 user devstack@n-api.service[72496]: exception: Volume bf2a00fd-4db6-4f32-85ad-623308dd8301 could not be found. Apr 12 00:29:29 user devstack@n-api.service[72496]: action_args: {'id': 'bf2a00fd-4db6-4f32-85ad-623308dd8301'} Apr 12 00:29:29 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bf2a00fd-4db6-4f32-85ad-623308dd8301 could not be found. (HTTP 404) (Request-ID: req-9c91af70-485a-4483-8d61-4afa5385d981) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bf2a00fd-4db6-4f32-85ad-623308dd8301 could not be found. Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bf2a00fd-4db6-4f32-85ad-623308dd8301 could not be found. Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bf2a00fd-4db6-4f32-85ad-623308dd8301 could not be found. Apr 12 00:29:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:29 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-b7ab883a-0728-461d-9d3a-0c16de516d45 tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] Returning 404 to user: Volume bf2a00fd-4db6-4f32-85ad-623308dd8301 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:29:29 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-b7ab883a-0728-461d-9d3a-0c16de516d45 tempest-VolumesNegativeTest-1247910315 tempest-VolumesNegativeTest-1247910315-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/bf2a00fd-4db6-4f32-85ad-623308dd8301" status: 404 len: 109 microversion: 2.1 time: 0.131590 Apr 12 00:29:29 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 00:29:29 2023] GET /compute/v2.1/os-volumes/bf2a00fd-4db6-4f32-85ad-623308dd8301 => generated 109 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:29:30 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-d2e09eaf-678a-4777-8caf-019743837301 tempest-VolumesGetTestJSON-1197798425 tempest-VolumesGetTestJSON-1197798425-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.559969 Apr 12 00:29:30 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 17/54] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 00:29:27 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 2562 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 12 00:29:30 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-6fef18d6-8718-4c5e-8199-540103531ab5 tempest-VolumesGetTestJSON-1197798425 tempest-VolumesGetTestJSON-1197798425-project-member] Calling method '.version_select at 0x7f7cd5519bd0>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:30 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-6fef18d6-8718-4c5e-8199-540103531ab5 tempest-VolumesGetTestJSON-1197798425 tempest-VolumesGetTestJSON-1197798425-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/201ad9fa-e710-4b48-b549-84bda1b26b16" status: 200 len: 352 microversion: 2.1 time: 0.070982 Apr 12 00:29:30 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 19/55] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 00:29:30 2023] GET /compute/v2.1/os-volumes/201ad9fa-e710-4b48-b549-84bda1b26b16 => generated 352 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:29:31 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-276251a4-98b2-4191-ae2b-322ad69c85af tempest-VolumesGetTestJSON-1197798425 tempest-VolumesGetTestJSON-1197798425-project-member] Calling method '.version_select at 0x7f7cd5558ca0>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:31 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-276251a4-98b2-4191-ae2b-322ad69c85af tempest-VolumesGetTestJSON-1197798425 tempest-VolumesGetTestJSON-1197798425-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/201ad9fa-e710-4b48-b549-84bda1b26b16" status: 200 len: 353 microversion: 2.1 time: 0.065663 Apr 12 00:29:31 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 20/56] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 00:29:31 2023] GET /compute/v2.1/os-volumes/201ad9fa-e710-4b48-b549-84bda1b26b16 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:29:31 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-09c9976c-7562-4de5-b5eb-b8ff1d338406 tempest-VolumesGetTestJSON-1197798425 tempest-VolumesGetTestJSON-1197798425-project-member] Calling method '.version_select at 0x7f7cd56ef910>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:31 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-09c9976c-7562-4de5-b5eb-b8ff1d338406 tempest-VolumesGetTestJSON-1197798425 tempest-VolumesGetTestJSON-1197798425-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/201ad9fa-e710-4b48-b549-84bda1b26b16" status: 200 len: 353 microversion: 2.1 time: 0.050934 Apr 12 00:29:31 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 18/57] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 00:29:31 2023] GET /compute/v2.1/os-volumes/201ad9fa-e710-4b48-b549-84bda1b26b16 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:29:31 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-5bf9cba3-9bdb-423e-942b-b510f0230f91 tempest-VolumesGetTestJSON-1197798425 tempest-VolumesGetTestJSON-1197798425-project-member] Calling method '.version_select at 0x7f7cd551a320>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:31 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-5bf9cba3-9bdb-423e-942b-b510f0230f91 tempest-VolumesGetTestJSON-1197798425 tempest-VolumesGetTestJSON-1197798425-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/201ad9fa-e710-4b48-b549-84bda1b26b16" status: 202 len: 0 microversion: 2.1 time: 0.077546 Apr 12 00:29:31 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 20/58] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 00:29:31 2023] DELETE /compute/v2.1/os-volumes/201ad9fa-e710-4b48-b549-84bda1b26b16 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:29:31 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-3d9eae07-0f95-4fb6-989a-6a33d9be27ef tempest-VolumesGetTestJSON-1197798425 tempest-VolumesGetTestJSON-1197798425-project-member] Calling method '.version_select at 0x7f7cd5559240>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:31 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-3d9eae07-0f95-4fb6-989a-6a33d9be27ef tempest-VolumesGetTestJSON-1197798425 tempest-VolumesGetTestJSON-1197798425-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/201ad9fa-e710-4b48-b549-84bda1b26b16" status: 200 len: 352 microversion: 2.1 time: 0.049987 Apr 12 00:29:31 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 21/59] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 00:29:31 2023] GET /compute/v2.1/os-volumes/201ad9fa-e710-4b48-b549-84bda1b26b16 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:29:32 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-66178450-a4f1-46c6-8b3e-88b7c7f655cb tempest-VolumesGetTestJSON-1197798425 tempest-VolumesGetTestJSON-1197798425-project-member] Calling method '.version_select at 0x7f7cd5508040>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:32 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-66178450-a4f1-46c6-8b3e-88b7c7f655cb tempest-VolumesGetTestJSON-1197798425 tempest-VolumesGetTestJSON-1197798425-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/201ad9fa-e710-4b48-b549-84bda1b26b16" status: 200 len: 352 microversion: 2.1 time: 0.065519 Apr 12 00:29:32 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 19/60] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 00:29:32 2023] GET /compute/v2.1/os-volumes/201ad9fa-e710-4b48-b549-84bda1b26b16 => generated 352 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:29:33 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-2c091699-27fb-44e5-b5a9-bbeaab5e10a4 tempest-VolumesGetTestJSON-1197798425 tempest-VolumesGetTestJSON-1197798425-project-member] Calling method '.version_select at 0x7f7cd55195a0>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:33 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-2c091699-27fb-44e5-b5a9-bbeaab5e10a4 tempest-VolumesGetTestJSON-1197798425 tempest-VolumesGetTestJSON-1197798425-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/201ad9fa-e710-4b48-b549-84bda1b26b16" status: 200 len: 352 microversion: 2.1 time: 0.063538 Apr 12 00:29:33 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 21/61] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 00:29:33 2023] GET /compute/v2.1/os-volumes/201ad9fa-e710-4b48-b549-84bda1b26b16 => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:29:34 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-abb3cef6-dc97-488b-9962-241d1d6dded4 tempest-VolumesGetTestJSON-1197798425 tempest-VolumesGetTestJSON-1197798425-project-member] Calling method '.version_select at 0x7f7cd5559750>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:34 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-abb3cef6-dc97-488b-9962-241d1d6dded4 tempest-VolumesGetTestJSON-1197798425 tempest-VolumesGetTestJSON-1197798425-project-member] HTTP exception thrown: Volume 201ad9fa-e710-4b48-b549-84bda1b26b16 could not be found. Apr 12 00:29:34 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-abb3cef6-dc97-488b-9962-241d1d6dded4 tempest-VolumesGetTestJSON-1197798425 tempest-VolumesGetTestJSON-1197798425-project-member] Request method failure captured: Apr 12 00:29:34 user devstack@n-api.service[72496]: request: GET /compute/v2.1/os-volumes/201ad9fa-e710-4b48-b549-84bda1b26b16 HTTP/1.1 Apr 12 00:29:34 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:29:34 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:29:34 user devstack@n-api.service[72496]: Connection: close Apr 12 00:29:34 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:29:34 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:29:34 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:29:34 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:29:34 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:29:34 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNftne-rd57_pqxMXTuGYyiBjT6OiaJHg_a-b6KeA8U1YMv6msAFfzHVTCzrbaQBWpF4_rI_k_wMh_jotyczEv4BIeGz-qbeM93v0pE5Lyct4U6khGub0hipVjO0jly35eG_IEa0ZftbAicMAisFsiWtIUGNg1_BHlgu0f6WrnKMyZaI Apr 12 00:29:34 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:29:34 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:29:34 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:29:34 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:29:34 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:29:34 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:29:34 user devstack@n-api.service[72496]: X-Project-Id: 4a4b524828e54591ba6e02f62d906f8f Apr 12 00:29:34 user devstack@n-api.service[72496]: X-Project-Name: tempest-VolumesGetTestJSON-1197798425 Apr 12 00:29:34 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:29:34 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:29:34 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4a4b524828e54591ba6e02f62d906f8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4a4b524828e54591ba6e02f62d906f8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4a4b524828e54591ba6e02f62d906f8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:29:34 user devstack@n-api.service[72496]: X-Tenant: tempest-VolumesGetTestJSON-1197798425 Apr 12 00:29:34 user devstack@n-api.service[72496]: X-Tenant-Id: 4a4b524828e54591ba6e02f62d906f8f Apr 12 00:29:34 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-VolumesGetTestJSON-1197798425 Apr 12 00:29:34 user devstack@n-api.service[72496]: X-User: tempest-VolumesGetTestJSON-1197798425-project-member Apr 12 00:29:34 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:29:34 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:29:34 user devstack@n-api.service[72496]: X-User-Id: e555cac7d3604fdeacb6800d904ff533 Apr 12 00:29:34 user devstack@n-api.service[72496]: X-User-Name: tempest-VolumesGetTestJSON-1197798425-project-member Apr 12 00:29:34 user devstack@n-api.service[72496]: method: Apr 12 00:29:34 user devstack@n-api.service[72496]: exception: Volume 201ad9fa-e710-4b48-b549-84bda1b26b16 could not be found. Apr 12 00:29:34 user devstack@n-api.service[72496]: action_args: {'id': '201ad9fa-e710-4b48-b549-84bda1b26b16'} Apr 12 00:29:34 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 201ad9fa-e710-4b48-b549-84bda1b26b16 could not be found. (HTTP 404) (Request-ID: req-72f88e51-bb26-42ae-8020-ad7962389e67) Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 201ad9fa-e710-4b48-b549-84bda1b26b16 could not be found. Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 201ad9fa-e710-4b48-b549-84bda1b26b16 could not be found. Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 201ad9fa-e710-4b48-b549-84bda1b26b16 could not be found. Apr 12 00:29:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:29:34 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-abb3cef6-dc97-488b-9962-241d1d6dded4 tempest-VolumesGetTestJSON-1197798425 tempest-VolumesGetTestJSON-1197798425-project-member] Returning 404 to user: Volume 201ad9fa-e710-4b48-b549-84bda1b26b16 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:29:34 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-abb3cef6-dc97-488b-9962-241d1d6dded4 tempest-VolumesGetTestJSON-1197798425 tempest-VolumesGetTestJSON-1197798425-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/201ad9fa-e710-4b48-b549-84bda1b26b16" status: 404 len: 109 microversion: 2.1 time: 0.036353 Apr 12 00:29:34 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 22/62] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 00:29:34 2023] GET /compute/v2.1/os-volumes/201ad9fa-e710-4b48-b549-84bda1b26b16 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:29:42 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1121770049", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "networks": [{"uuid": "4588d0e1-772f-4c76-b467-7e46031e477d"}]}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:42 user devstack@n-api.service[72494]: DEBUG nova.network.neutron [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] validate_networks() for [('4588d0e1-772f-4c76-b467-7e46031e477d', None, None, None, None, None)] {{(pid=72494) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:29:43 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Flavor limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:29:43 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Image limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:29:43 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Flavor pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:29:43 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Image pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:29:43 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:29:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:29:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:29:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:29:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:29:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:29:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:29:43 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Getting quotas for project 6ee31cdc6f4e4c2b9a8ec1e1c5076010. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:29:43 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Getting quotas for user 920d6d79e38e45fcb5153e712605764f and project 6ee31cdc6f4e4c2b9a8ec1e1c5076010. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:29:43 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Going to run 1 instances... {{(pid=72494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:29:43 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:29:43 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-af1e12ba-cb42-4785-b9f5-76a6159ddd27 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.767728 Apr 12 00:29:43 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 20/63] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:29:41 2023] POST /compute/v2.1/servers => generated 378 bytes in 1769 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:29:43 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-bdcb931c-d96b-439d-9945-3a77bfb43ddf tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:43 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-bdcb931c-d96b-439d-9945-3a77bfb43ddf tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:29:43 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-bdcb931c-d96b-439d-9945-3a77bfb43ddf tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920d6d79e38e45fcb5153e712605764f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee31cdc6f4e4c2b9a8ec1e1c5076010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:29:43 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-bdcb931c-d96b-439d-9945-3a77bfb43ddf tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" status: 200 len: 1211 microversion: 2.1 time: 0.155414 Apr 12 00:29:43 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 22/64] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:29:43 2023] GET /compute/v2.1/servers/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 => generated 1211 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:46 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-254044738", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:46 user devstack@n-api.service[72496]: DEBUG nova.network.neutron [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] validate_networks() for [('2672ea92-a779-4d3e-8b39-13317b97c3a7', None, None, None, None, None)] {{(pid=72496) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:29:47 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Flavor limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:29:47 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Image limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:29:47 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Flavor pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:29:47 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Image pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:29:47 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:29:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:29:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:29:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:29:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:29:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:29:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:29:47 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Getting quotas for project fcf1fea74ef143e6b394e41e7c4ed495. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:29:47 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Getting quotas for user 6b9421443b2f421298a934122c6a8b8c and project fcf1fea74ef143e6b394e41e7c4ed495. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:29:47 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Going to run 1 instances... {{(pid=72496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:29:47 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:29:47 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-8640ef26-6ebe-402e-8f91-f8ef225a097c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.786755 Apr 12 00:29:47 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 23/65] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:29:46 2023] POST /compute/v2.1/servers => generated 381 bytes in 1789 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:29:47 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-9f9da093-b06a-499c-b3e6-29b137ff0191 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:47 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-9f9da093-b06a-499c-b3e6-29b137ff0191 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:29:47 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-9f9da093-b06a-499c-b3e6-29b137ff0191 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9421443b2f421298a934122c6a8b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf1fea74ef143e6b394e41e7c4ed495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:29:47 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-9f9da093-b06a-499c-b3e6-29b137ff0191 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0" status: 200 len: 1215 microversion: 2.1 time: 0.129908 Apr 12 00:29:47 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 21/66] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:29:47 2023] GET /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0 => generated 1215 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:48 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1609902258", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:48 user devstack@n-api.service[72495]: DEBUG nova.network.neutron [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] validate_networks() for [('2672ea92-a779-4d3e-8b39-13317b97c3a7', None, None, None, None, None)] {{(pid=72495) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:29:49 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-5e20ad75-d2aa-42bf-a5c5-1a2baa3045a1 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Action: 'create', calling method: .version_select at 0x7f7cd542a710>, body: {"keypair": {"name": "tempest-keypair-1452487550", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCGT3/DnJIOrFUunT4rNKGL0+IUDZqxr1CY0XgXb3b7JxUghNoSTSgpBo+JC/Xg/vACyQAIbWpd82lcIfzIJk4v0g/qQrAg086ADOngzLc7faYjLT+/4s1KLQ6ru//TTQ=="}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:49 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-5e20ad75-d2aa-42bf-a5c5-1a2baa3045a1 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting quotas for project d8ba626fdf264b879099a89097845153. Resources: {'key_pairs'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:29:49 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-5e20ad75-d2aa-42bf-a5c5-1a2baa3045a1 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting quotas for user d658147b4def4d12a16381d4c19357e3 and project d8ba626fdf264b879099a89097845153. Resources: {'key_pairs'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:29:49 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-5e20ad75-d2aa-42bf-a5c5-1a2baa3045a1 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.486925 Apr 12 00:29:49 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 24/67] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 00:29:48 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:29:49 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Flavor limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:29:49 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Image limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:29:49 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Flavor pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:29:49 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Image pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:29:49 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:29:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:29:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:29:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:29:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:29:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:29:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:29:49 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Getting quotas for project fcf1fea74ef143e6b394e41e7c4ed495. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:29:49 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Getting quotas for user 6b9421443b2f421298a934122c6a8b8c and project fcf1fea74ef143e6b394e41e7c4ed495. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:29:49 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Going to run 1 instances... {{(pid=72495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:29:49 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:29:49 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-c16b506a-8d75-47c3-b2af-b53acef25574 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.866526 Apr 12 00:29:49 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 23/68] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:29:48 2023] POST /compute/v2.1/servers => generated 381 bytes in 1870 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:29:49 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-1c0a47cd-a05e-4afb-a23f-0cb0c6100ab9 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:49 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-1c0a47cd-a05e-4afb-a23f-0cb0c6100ab9 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:29:50 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-1c0a47cd-a05e-4afb-a23f-0cb0c6100ab9 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9421443b2f421298a934122c6a8b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf1fea74ef143e6b394e41e7c4ed495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:29:50 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-1c0a47cd-a05e-4afb-a23f-0cb0c6100ab9 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" status: 200 len: 1216 microversion: 2.1 time: 0.147184 Apr 12 00:29:50 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 22/69] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:29:49 2023] GET /compute/v2.1/servers/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 => generated 1216 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:53 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-aa06dde8-ec0d-44d4-b4f6-d37c45706c95 req-4412d621-5b5d-4be0-80cf-302f2d82152c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9", "tag": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:53 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-aa06dde8-ec0d-44d4-b4f6-d37c45706c95 req-4412d621-5b5d-4be0-80cf-302f2d82152c service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:29:53 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-aa06dde8-ec0d-44d4-b4f6-d37c45706c95 req-4412d621-5b5d-4be0-80cf-302f2d82152c service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:29:53 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-aa06dde8-ec0d-44d4-b4f6-d37c45706c95 req-4412d621-5b5d-4be0-80cf-302f2d82152c service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:29:53 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-aa06dde8-ec0d-44d4-b4f6-d37c45706c95 req-4412d621-5b5d-4be0-80cf-302f2d82152c service nova] Creating event network-changed:cc385c2b-9f16-4daf-a929-f3c9e133e5fa for instance ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 on user Apr 12 00:29:53 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-aa06dde8-ec0d-44d4-b4f6-d37c45706c95 req-4412d621-5b5d-4be0-80cf-302f2d82152c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=72496) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 00:29:53 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-aa06dde8-ec0d-44d4-b4f6-d37c45706c95 req-4412d621-5b5d-4be0-80cf-302f2d82152c service nova] Acquired lock "compute-rpcapi-router" {{(pid=72496) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 12 00:29:53 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b697fc39-c970-4f87-9825-96276cc27da1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:29:53 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b697fc39-c970-4f87-9825-96276cc27da1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:29:53 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b697fc39-c970-4f87-9825-96276cc27da1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:29:53 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b697fc39-c970-4f87-9825-96276cc27da1 None None] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:29:53 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b697fc39-c970-4f87-9825-96276cc27da1 None None] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:29:53 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b697fc39-c970-4f87-9825-96276cc27da1 None None] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:29:53 user devstack@n-api.service[72496]: INFO nova.compute.rpcapi [None req-b697fc39-c970-4f87-9825-96276cc27da1 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 12 00:29:53 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b697fc39-c970-4f87-9825-96276cc27da1 None None] Releasing lock "compute-rpcapi-router" {{(pid=72496) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 12 00:29:53 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-b697fc39-c970-4f87-9825-96276cc27da1 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172103 Apr 12 00:29:53 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 25/70] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:29:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:29:55 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1087783512", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "bb566dde-458e-4ead-a04b-6dbdb540007d"}], "security_groups": [{"name": "tempest-securitygroup--1163846610"}], "key_name": "tempest-keypair-1452487550", "user_data": "}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:55 user devstack@n-api.service[72495]: DEBUG nova.network.neutron [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] validate_networks() for [('bb566dde-458e-4ead-a04b-6dbdb540007d', None, None, None, None, None)] {{(pid=72495) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:29:55 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:29:55 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:29:55 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-dc895343-dff3-4a2d-9112-bae24e93fc12 req-0b6e9e45-9770-44df-953f-c76e777b3599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d895d64-319f-4c67-8c20-ef0d0437a1f0", "tag": "e92d06cb-6535-4389-b328-57add5f4f812"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:55 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-dc895343-dff3-4a2d-9112-bae24e93fc12 req-0b6e9e45-9770-44df-953f-c76e777b3599 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:29:55 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-dc895343-dff3-4a2d-9112-bae24e93fc12 req-0b6e9e45-9770-44df-953f-c76e777b3599 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:29:55 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-dc895343-dff3-4a2d-9112-bae24e93fc12 req-0b6e9e45-9770-44df-953f-c76e777b3599 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:29:55 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-dc895343-dff3-4a2d-9112-bae24e93fc12 req-0b6e9e45-9770-44df-953f-c76e777b3599 service nova] Creating event network-changed:e92d06cb-6535-4389-b328-57add5f4f812 for instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 on user Apr 12 00:29:55 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-dc895343-dff3-4a2d-9112-bae24e93fc12 req-0b6e9e45-9770-44df-953f-c76e777b3599 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=72494) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 00:29:55 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-dc895343-dff3-4a2d-9112-bae24e93fc12 req-0b6e9e45-9770-44df-953f-c76e777b3599 service nova] Acquired lock "compute-rpcapi-router" {{(pid=72494) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 12 00:29:55 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-984cb93b-50b9-4425-88aa-454ee9e5f224 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:29:55 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-984cb93b-50b9-4425-88aa-454ee9e5f224 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:29:55 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-984cb93b-50b9-4425-88aa-454ee9e5f224 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:29:55 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-984cb93b-50b9-4425-88aa-454ee9e5f224 None None] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:29:55 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-984cb93b-50b9-4425-88aa-454ee9e5f224 None None] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:29:55 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-984cb93b-50b9-4425-88aa-454ee9e5f224 None None] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:29:55 user devstack@n-api.service[72494]: INFO nova.compute.rpcapi [None req-984cb93b-50b9-4425-88aa-454ee9e5f224 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 12 00:29:55 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-984cb93b-50b9-4425-88aa-454ee9e5f224 None None] Releasing lock "compute-rpcapi-router" {{(pid=72494) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 12 00:29:55 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-984cb93b-50b9-4425-88aa-454ee9e5f224 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176468 Apr 12 00:29:55 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 23/71] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:29:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:29:57 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:29:57 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:29:57 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:29:57 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:29:57 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:29:57 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:29:57 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:29:57 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:29:57 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:29:57 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:29:57 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:29:57 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting quotas for project d8ba626fdf264b879099a89097845153. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:29:57 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting quotas for user d658147b4def4d12a16381d4c19357e3 and project d8ba626fdf264b879099a89097845153. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:29:57 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Going to run 1 instances... {{(pid=72495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:29:57 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:29:57 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-5c6d50b1-6808-4249-b91e-9bfb8c841e26 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.559287 Apr 12 00:29:57 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 24/72] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:29:55 2023] POST /compute/v2.1/servers => generated 407 bytes in 2561 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:29:57 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-2398702f-21b8-4d8d-8a12-40a61cfae8fe tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:29:57 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-2398702f-21b8-4d8d-8a12-40a61cfae8fe tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:29:57 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-2398702f-21b8-4d8d-8a12-40a61cfae8fe tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:29:57 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-2398702f-21b8-4d8d-8a12-40a61cfae8fe tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 200 len: 1233 microversion: 2.1 time: 0.278203 Apr 12 00:29:57 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 26/73] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:29:57 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 1233 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:29:58 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-d532125f-edd5-4e8f-9558-1b1117a5b507 req-549a629e-15f5-4b4d-84ae-8ffd23181196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050", "tag": "8cb07b1c-aa00-4fcf-983c-4b42566ef948"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:58 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-d532125f-edd5-4e8f-9558-1b1117a5b507 req-549a629e-15f5-4b4d-84ae-8ffd23181196 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:29:58 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-d532125f-edd5-4e8f-9558-1b1117a5b507 req-549a629e-15f5-4b4d-84ae-8ffd23181196 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:29:58 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-d532125f-edd5-4e8f-9558-1b1117a5b507 req-549a629e-15f5-4b4d-84ae-8ffd23181196 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:29:58 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-d532125f-edd5-4e8f-9558-1b1117a5b507 req-549a629e-15f5-4b4d-84ae-8ffd23181196 service nova] Creating event network-changed:8cb07b1c-aa00-4fcf-983c-4b42566ef948 for instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 on user Apr 12 00:29:58 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-d532125f-edd5-4e8f-9558-1b1117a5b507 req-549a629e-15f5-4b4d-84ae-8ffd23181196 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100374 Apr 12 00:29:58 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 24/74] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:29:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:29:59 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-cbeef046-6391-4eae-a01d-c85b6b597789 req-cb38d746-76e4-4781-9e41-ee47dfe47d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9", "name": "network-vif-plugged", "status": "completed", "tag": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-cbeef046-6391-4eae-a01d-c85b6b597789 req-cb38d746-76e4-4781-9e41-ee47dfe47d1b service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:29:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-cbeef046-6391-4eae-a01d-c85b6b597789 req-cb38d746-76e4-4781-9e41-ee47dfe47d1b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:29:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-cbeef046-6391-4eae-a01d-c85b6b597789 req-cb38d746-76e4-4781-9e41-ee47dfe47d1b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:29:59 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-cbeef046-6391-4eae-a01d-c85b6b597789 req-cb38d746-76e4-4781-9e41-ee47dfe47d1b service nova] Creating event network-vif-plugged:cc385c2b-9f16-4daf-a929-f3c9e133e5fa for instance ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 on user Apr 12 00:29:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-cbeef046-6391-4eae-a01d-c85b6b597789 req-cb38d746-76e4-4781-9e41-ee47dfe47d1b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=72495) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 00:29:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-cbeef046-6391-4eae-a01d-c85b6b597789 req-cb38d746-76e4-4781-9e41-ee47dfe47d1b service nova] Acquired lock "compute-rpcapi-router" {{(pid=72495) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 12 00:29:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-464dd0e0-2477-44ec-bab0-8b45ff834d40 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:29:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-464dd0e0-2477-44ec-bab0-8b45ff834d40 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:29:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-464dd0e0-2477-44ec-bab0-8b45ff834d40 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:29:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-464dd0e0-2477-44ec-bab0-8b45ff834d40 None None] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:29:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-464dd0e0-2477-44ec-bab0-8b45ff834d40 None None] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:29:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-464dd0e0-2477-44ec-bab0-8b45ff834d40 None None] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:29:59 user devstack@n-api.service[72495]: INFO nova.compute.rpcapi [None req-464dd0e0-2477-44ec-bab0-8b45ff834d40 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 12 00:29:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-464dd0e0-2477-44ec-bab0-8b45ff834d40 None None] Releasing lock "compute-rpcapi-router" {{(pid=72495) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 12 00:29:59 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-464dd0e0-2477-44ec-bab0-8b45ff834d40 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127095 Apr 12 00:29:59 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 25/75] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:29:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:29:59 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-fa0e6268-3873-426b-99bb-8a79be14ef14 req-1f4913f3-f82e-4913-9364-a85cbbb5a946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d895d64-319f-4c67-8c20-ef0d0437a1f0", "name": "network-vif-plugged", "status": "completed", "tag": "e92d06cb-6535-4389-b328-57add5f4f812"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:29:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-fa0e6268-3873-426b-99bb-8a79be14ef14 req-1f4913f3-f82e-4913-9364-a85cbbb5a946 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:29:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-fa0e6268-3873-426b-99bb-8a79be14ef14 req-1f4913f3-f82e-4913-9364-a85cbbb5a946 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:29:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-fa0e6268-3873-426b-99bb-8a79be14ef14 req-1f4913f3-f82e-4913-9364-a85cbbb5a946 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:29:59 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-fa0e6268-3873-426b-99bb-8a79be14ef14 req-1f4913f3-f82e-4913-9364-a85cbbb5a946 service nova] Creating event network-vif-plugged:e92d06cb-6535-4389-b328-57add5f4f812 for instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 on user Apr 12 00:29:59 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-fa0e6268-3873-426b-99bb-8a79be14ef14 req-1f4913f3-f82e-4913-9364-a85cbbb5a946 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068431 Apr 12 00:29:59 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 27/76] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:29:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:30:01 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-ee2d40c1-b3c9-49d3-8e5d-75e22cf80a87 req-d503258d-e63c-4394-b1c1-bcf0c99ec359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9", "name": "network-vif-plugged", "status": "completed", "tag": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:01 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=10 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:30:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-ee2d40c1-b3c9-49d3-8e5d-75e22cf80a87 req-d503258d-e63c-4394-b1c1-bcf0c99ec359 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-ee2d40c1-b3c9-49d3-8e5d-75e22cf80a87 req-d503258d-e63c-4394-b1c1-bcf0c99ec359 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-ee2d40c1-b3c9-49d3-8e5d-75e22cf80a87 req-d503258d-e63c-4394-b1c1-bcf0c99ec359 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:01 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-ee2d40c1-b3c9-49d3-8e5d-75e22cf80a87 req-d503258d-e63c-4394-b1c1-bcf0c99ec359 service nova] Creating event network-vif-plugged:cc385c2b-9f16-4daf-a929-f3c9e133e5fa for instance ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 on user Apr 12 00:30:01 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-ee2d40c1-b3c9-49d3-8e5d-75e22cf80a87 req-d503258d-e63c-4394-b1c1-bcf0c99ec359 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087316 Apr 12 00:30:01 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 25/77] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:30:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:30:01 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-8518b450-3d3a-451d-ae6f-62e81b9bcfa3 req-4f7e6307-e93e-42af-9e7c-aae2d0ebbb25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d895d64-319f-4c67-8c20-ef0d0437a1f0", "name": "network-vif-plugged", "status": "completed", "tag": "e92d06cb-6535-4389-b328-57add5f4f812"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:02 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8518b450-3d3a-451d-ae6f-62e81b9bcfa3 req-4f7e6307-e93e-42af-9e7c-aae2d0ebbb25 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:02 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8518b450-3d3a-451d-ae6f-62e81b9bcfa3 req-4f7e6307-e93e-42af-9e7c-aae2d0ebbb25 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:02 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8518b450-3d3a-451d-ae6f-62e81b9bcfa3 req-4f7e6307-e93e-42af-9e7c-aae2d0ebbb25 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:02 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-8518b450-3d3a-451d-ae6f-62e81b9bcfa3 req-4f7e6307-e93e-42af-9e7c-aae2d0ebbb25 service nova] Creating event network-vif-plugged:e92d06cb-6535-4389-b328-57add5f4f812 for instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 on user Apr 12 00:30:02 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-8518b450-3d3a-451d-ae6f-62e81b9bcfa3 req-4f7e6307-e93e-42af-9e7c-aae2d0ebbb25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057078 Apr 12 00:30:02 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 26/78] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:30:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:30:04 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:30:04 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-ec403757-8766-4f0d-a72c-000b23ded50f req-da3f2ea6-9d28-4c12-9a92-816970b7418c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050", "name": "network-vif-plugged", "status": "completed", "tag": "8cb07b1c-aa00-4fcf-983c-4b42566ef948"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-ec403757-8766-4f0d-a72c-000b23ded50f req-da3f2ea6-9d28-4c12-9a92-816970b7418c service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-ec403757-8766-4f0d-a72c-000b23ded50f req-da3f2ea6-9d28-4c12-9a92-816970b7418c service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-ec403757-8766-4f0d-a72c-000b23ded50f req-da3f2ea6-9d28-4c12-9a92-816970b7418c service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:04 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-ec403757-8766-4f0d-a72c-000b23ded50f req-da3f2ea6-9d28-4c12-9a92-816970b7418c service nova] Creating event network-vif-plugged:8cb07b1c-aa00-4fcf-983c-4b42566ef948 for instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 on user Apr 12 00:30:04 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-ec403757-8766-4f0d-a72c-000b23ded50f req-da3f2ea6-9d28-4c12-9a92-816970b7418c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079113 Apr 12 00:30:04 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 28/79] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:30:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:30:05 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-e963c65c-2854-4662-9146-99f46e2ed059 req-104bb53c-b26b-425f-bb13-aa68958d428e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbe6d6bc-65a6-469a-89a0-7e4c51620b14", "tag": "b99b54c2-0b21-42ea-91d0-087aa230da7e"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-e963c65c-2854-4662-9146-99f46e2ed059 req-104bb53c-b26b-425f-bb13-aa68958d428e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-e963c65c-2854-4662-9146-99f46e2ed059 req-104bb53c-b26b-425f-bb13-aa68958d428e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-e963c65c-2854-4662-9146-99f46e2ed059 req-104bb53c-b26b-425f-bb13-aa68958d428e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:05 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-e963c65c-2854-4662-9146-99f46e2ed059 req-104bb53c-b26b-425f-bb13-aa68958d428e service nova] Creating event network-changed:b99b54c2-0b21-42ea-91d0-087aa230da7e for instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 on user Apr 12 00:30:05 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-e963c65c-2854-4662-9146-99f46e2ed059 req-104bb53c-b26b-425f-bb13-aa68958d428e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042739 Apr 12 00:30:05 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 26/80] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:30:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:30:06 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-299e8450-9cbd-44c4-b381-c115698bbf0c req-b8880cc9-2385-418e-a99e-b36c2f8920b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050", "name": "network-vif-plugged", "status": "completed", "tag": "8cb07b1c-aa00-4fcf-983c-4b42566ef948"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:06 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-299e8450-9cbd-44c4-b381-c115698bbf0c req-b8880cc9-2385-418e-a99e-b36c2f8920b5 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:06 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-299e8450-9cbd-44c4-b381-c115698bbf0c req-b8880cc9-2385-418e-a99e-b36c2f8920b5 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:06 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-299e8450-9cbd-44c4-b381-c115698bbf0c req-b8880cc9-2385-418e-a99e-b36c2f8920b5 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:06 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-299e8450-9cbd-44c4-b381-c115698bbf0c req-b8880cc9-2385-418e-a99e-b36c2f8920b5 service nova] Creating event network-vif-plugged:8cb07b1c-aa00-4fcf-983c-4b42566ef948 for instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 on user Apr 12 00:30:06 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-299e8450-9cbd-44c4-b381-c115698bbf0c req-b8880cc9-2385-418e-a99e-b36c2f8920b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103222 Apr 12 00:30:06 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 27/81] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:30:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:30:09 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=12 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:30:09 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-8fcb93d4-696c-4a84-857e-f47086c73811 req-58890fe2-7ce5-414a-873f-20684c7bb775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe6d6bc-65a6-469a-89a0-7e4c51620b14", "name": "network-vif-plugged", "status": "completed", "tag": "b99b54c2-0b21-42ea-91d0-087aa230da7e"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-8fcb93d4-696c-4a84-857e-f47086c73811 req-58890fe2-7ce5-414a-873f-20684c7bb775 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-8fcb93d4-696c-4a84-857e-f47086c73811 req-58890fe2-7ce5-414a-873f-20684c7bb775 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-8fcb93d4-696c-4a84-857e-f47086c73811 req-58890fe2-7ce5-414a-873f-20684c7bb775 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:09 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-8fcb93d4-696c-4a84-857e-f47086c73811 req-58890fe2-7ce5-414a-873f-20684c7bb775 service nova] Creating event network-vif-plugged:b99b54c2-0b21-42ea-91d0-087aa230da7e for instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 on user Apr 12 00:30:09 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-8fcb93d4-696c-4a84-857e-f47086c73811 req-58890fe2-7ce5-414a-873f-20684c7bb775 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056593 Apr 12 00:30:09 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 29/82] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:30:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:30:11 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:30:11 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-f0bb83be-b6c7-4648-bed4-cee3175e17ef req-b4f8a869-5e00-42b9-b778-522273f0836b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe6d6bc-65a6-469a-89a0-7e4c51620b14", "name": "network-vif-plugged", "status": "completed", "tag": "b99b54c2-0b21-42ea-91d0-087aa230da7e"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f0bb83be-b6c7-4648-bed4-cee3175e17ef req-b4f8a869-5e00-42b9-b778-522273f0836b service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f0bb83be-b6c7-4648-bed4-cee3175e17ef req-b4f8a869-5e00-42b9-b778-522273f0836b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f0bb83be-b6c7-4648-bed4-cee3175e17ef req-b4f8a869-5e00-42b9-b778-522273f0836b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:11 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-f0bb83be-b6c7-4648-bed4-cee3175e17ef req-b4f8a869-5e00-42b9-b778-522273f0836b service nova] Creating event network-vif-plugged:b99b54c2-0b21-42ea-91d0-087aa230da7e for instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 on user Apr 12 00:30:11 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-f0bb83be-b6c7-4648-bed4-cee3175e17ef req-b4f8a869-5e00-42b9-b778-522273f0836b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034325 Apr 12 00:30:11 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 27/83] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:30:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:30:16 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=14 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:30:16 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:30:16 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:30:16 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=12 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:30:16 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-0c260499-4380-4fda-bbab-aef6209e54ca tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Action: 'create', calling method: .version_select at 0x7f7cd54a79a0>, body: {"keypair": {"name": "tempest-keypair-436204141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlqavOG73YHP/jCE8QYd9eB/mTDgD50nbY+MW+ec/fUDNZvJ4gLz94SBNm7woJpGnkkYo5CN6rOisg49f1aZtON5pBAxIRrPclADfCbPyd0Gh0X+A28pjj3Xe6fQGyNlA=="}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:17 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-0c260499-4380-4fda-bbab-aef6209e54ca tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Getting quotas for project bff88f0df3414610858ecf3d60295c26. Resources: {'key_pairs'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:30:17 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-0c260499-4380-4fda-bbab-aef6209e54ca tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Getting quotas for user e4edaa34382341fd8f99f9d0921d80b6 and project bff88f0df3414610858ecf3d60295c26. Resources: {'key_pairs'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:30:17 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-0c260499-4380-4fda-bbab-aef6209e54ca tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.111782 Apr 12 00:30:17 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 28/84] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 00:30:16 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:30:21 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:30:21 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=12 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:30:21 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-5084fc3a-d1b3-419c-9d81-f11a5b07c157 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Action: 'create', calling method: .version_select at 0x7f7cd54cd870>, body: {"keypair": {"name": "tempest-keypair-992126776", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrWK9ihmxKkdsVErSw7OgZuNUIpL+qTe4ZmI15q/9/+aifoFw87ghSd+P2MBXDve2Z7zrfv9r+02hHhHZyDBer4WWDnGOM/ysnpJg7MD9NC8prdOD/PW1ucWndbOaiUMg=="}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:21 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-5084fc3a-d1b3-419c-9d81-f11a5b07c157 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Getting quotas for project 88cf7bd87e954fa892ea0da5332a6589. Resources: {'key_pairs'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:30:21 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-5084fc3a-d1b3-419c-9d81-f11a5b07c157 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Getting quotas for user 31fe897a730b44bb8c8bf9d92938bc9b and project 88cf7bd87e954fa892ea0da5332a6589. Resources: {'key_pairs'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:30:21 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-5084fc3a-d1b3-419c-9d81-f11a5b07c157 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.315940 Apr 12 00:30:21 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 30/85] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 00:30:21 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:30:21 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-616241968", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "networks": [{"uuid": "f1b0803c-dc20-47d1-8c89-af2a7f867e2c"}], "security_groups": [{"name": "tempest-securitygroup--1811376861"}], "key_name": "tempest-keypair-436204141", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:21 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:30:21 user devstack@n-api.service[72494]: DEBUG nova.network.neutron [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] validate_networks() for [('f1b0803c-dc20-47d1-8c89-af2a7f867e2c', None, None, None, None, None)] {{(pid=72494) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:30:21 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=12 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:30:22 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Flavor limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:30:22 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Image limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:30:22 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Flavor pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:30:22 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Image pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:30:22 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:30:22 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:22 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:22 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:22 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:22 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:22 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:22 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Getting quotas for project bff88f0df3414610858ecf3d60295c26. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:30:22 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Getting quotas for user e4edaa34382341fd8f99f9d0921d80b6 and project bff88f0df3414610858ecf3d60295c26. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:30:22 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Going to run 1 instances... {{(pid=72494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:30:22 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:30:22 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-d4c318ae-6560-47f6-8f06-90fd40dd15c9 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.802736 Apr 12 00:30:22 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 28/86] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:30:21 2023] POST /compute/v2.1/servers => generated 404 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:30:22 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-6afd27aa-f459-473a-a379-60d930cfbefb tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:22 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-6afd27aa-f459-473a-a379-60d930cfbefb tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:30:22 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-6afd27aa-f459-473a-a379-60d930cfbefb tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4edaa34382341fd8f99f9d0921d80b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff88f0df3414610858ecf3d60295c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:30:22 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-6afd27aa-f459-473a-a379-60d930cfbefb tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47" status: 200 len: 1224 microversion: 2.1 time: 0.115533 Apr 12 00:30:22 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 29/87] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:30:22 2023] GET /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47 => generated 1224 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:23 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-f18041ed-b0b1-4af9-88e1-fbc3002aa67d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Action: 'create', calling method: .version_select at 0x7f7cd54ce560>, body: {"keypair": {"name": "tempest-keypair-471743196", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKwv9DP07Ijbmhf9HWXXk0ASaizoMib0VlzNwq68ABkK0qUQM6kvcfZGKCprGsyQlklT8ps56C4cjgE6G/tVg5LT839vcYk+Q9zEFFAw8hfrSGWgE8ruQmdnfY/1EqjEg=="}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:23 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-f18041ed-b0b1-4af9-88e1-fbc3002aa67d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Getting quotas for project e7abb0634c7c44699a5197b9876b612c. Resources: {'key_pairs'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:30:23 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-f18041ed-b0b1-4af9-88e1-fbc3002aa67d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Getting quotas for user 3dae26de34e047b8b4fe08b2e56a4b62 and project e7abb0634c7c44699a5197b9876b612c. Resources: {'key_pairs'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:30:23 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-f18041ed-b0b1-4af9-88e1-fbc3002aa67d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.49 time: 0.140304 Apr 12 00:30:23 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 31/88] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 00:30:23 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 144 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 00:30:24 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1287308895", "imageRef": "a44d3d49-491b-40c9-8c3b-bc3f938db25c", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "1a490074-20a7-48ab-a8e1-1f0eca33c560"}], "security_groups": [{"name": "tempest-securitygroup--904352683"}], "key_name": "tempest-keypair-992126776", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:24 user devstack@n-api.service[72494]: DEBUG nova.network.neutron [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] validate_networks() for [('1a490074-20a7-48ab-a8e1-1f0eca33c560', None, None, None, None, None)] {{(pid=72494) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:30:25 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Flavor limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:30:25 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Image limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:30:25 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Flavor pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:30:25 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Image pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:30:25 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:30:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:25 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Getting quotas for project 88cf7bd87e954fa892ea0da5332a6589. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:30:25 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Getting quotas for user 31fe897a730b44bb8c8bf9d92938bc9b and project 88cf7bd87e954fa892ea0da5332a6589. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:30:25 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Going to run 1 instances... {{(pid=72494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:30:25 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a44d3d49-491b-40c9-8c3b-bc3f938db25c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:30:25 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-78b40724-5a0c-4344-b336-310ca0c26be8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.319999 Apr 12 00:30:25 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 29/89] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:30:24 2023] POST /compute/v2.1/servers => generated 403 bytes in 1344 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:30:25 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-296d2b31-5af6-4cb0-bc3d-bf6acf386b29 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:25 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-296d2b31-5af6-4cb0-bc3d-bf6acf386b29 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:30:25 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-296d2b31-5af6-4cb0-bc3d-bf6acf386b29 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe897a730b44bb8c8bf9d92938bc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cf7bd87e954fa892ea0da5332a6589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:30:25 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-296d2b31-5af6-4cb0-bc3d-bf6acf386b29 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb" status: 200 len: 1239 microversion: 2.1 time: 0.129817 Apr 12 00:30:25 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 30/90] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:30:25 2023] GET /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb => generated 1239 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:26 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1251564681", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "18644b33-51c6-42ac-af84-c3d28fca37c8"}], "security_groups": [{"name": "tempest-securitygroup--424613032"}], "key_name": "tempest-keypair-471743196", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:26 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-34ec2dfe-b04d-4639-90d5-ee9ac5e1c4f2 req-c5b2241f-04d3-4822-94b2-fde7526783ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5be536dd-61f5-4a17-a734-029b25739a47", "tag": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-34ec2dfe-b04d-4639-90d5-ee9ac5e1c4f2 req-c5b2241f-04d3-4822-94b2-fde7526783ae service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-34ec2dfe-b04d-4639-90d5-ee9ac5e1c4f2 req-c5b2241f-04d3-4822-94b2-fde7526783ae service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-34ec2dfe-b04d-4639-90d5-ee9ac5e1c4f2 req-c5b2241f-04d3-4822-94b2-fde7526783ae service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:26 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-34ec2dfe-b04d-4639-90d5-ee9ac5e1c4f2 req-c5b2241f-04d3-4822-94b2-fde7526783ae service nova] Creating event network-changed:bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 for instance 5be536dd-61f5-4a17-a734-029b25739a47 on user Apr 12 00:30:26 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-34ec2dfe-b04d-4639-90d5-ee9ac5e1c4f2 req-c5b2241f-04d3-4822-94b2-fde7526783ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073608 Apr 12 00:30:26 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 30/91] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:30:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:30:26 user devstack@n-api.service[72496]: DEBUG nova.network.neutron [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] validate_networks() for [('18644b33-51c6-42ac-af84-c3d28fca37c8', None, None, None, None, None)] {{(pid=72496) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:30:27 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Flavor limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:30:27 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Image limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:30:27 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Flavor pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:30:27 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Image pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:30:27 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:30:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:27 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Getting quotas for project e7abb0634c7c44699a5197b9876b612c. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:30:27 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Getting quotas for user 3dae26de34e047b8b4fe08b2e56a4b62 and project e7abb0634c7c44699a5197b9876b612c. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:30:27 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Going to run 1 instances... {{(pid=72496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:30:27 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:30:27 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-9cd20724-f4c1-4232-b2d9-adcfe3b673ac tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.49 time: 1.406471 Apr 12 00:30:27 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 32/92] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 00:30:26 2023] POST /compute/v2.1/servers => generated 403 bytes in 1410 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 00:30:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-0abac215-87ff-4467-808b-8d0b68999ba2 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:27 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-0abac215-87ff-4467-808b-8d0b68999ba2 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:30:27 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-0abac215-87ff-4467-808b-8d0b68999ba2 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dae26de34e047b8b4fe08b2e56a4b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7abb0634c7c44699a5197b9876b612c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:30:28 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-0abac215-87ff-4467-808b-8d0b68999ba2 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3dae26de34e047b8b4fe08b2e56a4b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7abb0634c7c44699a5197b9876b612c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:30:28 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-0abac215-87ff-4467-808b-8d0b68999ba2 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3dae26de34e047b8b4fe08b2e56a4b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7abb0634c7c44699a5197b9876b612c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:30:28 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-0abac215-87ff-4467-808b-8d0b68999ba2 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097" status: 200 len: 1320 microversion: 2.49 time: 0.118347 Apr 12 00:30:28 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 31/93] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:30:27 2023] GET /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097 => generated 1320 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:29 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-a1f1e601-36fa-4063-87e5-f577688167a2 req-7dea4bd6-2792-4e22-8642-9ffba4647c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be536dd-61f5-4a17-a734-029b25739a47", "name": "network-vif-plugged", "status": "completed", "tag": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-a1f1e601-36fa-4063-87e5-f577688167a2 req-7dea4bd6-2792-4e22-8642-9ffba4647c9e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-a1f1e601-36fa-4063-87e5-f577688167a2 req-7dea4bd6-2792-4e22-8642-9ffba4647c9e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-a1f1e601-36fa-4063-87e5-f577688167a2 req-7dea4bd6-2792-4e22-8642-9ffba4647c9e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:29 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-a1f1e601-36fa-4063-87e5-f577688167a2 req-7dea4bd6-2792-4e22-8642-9ffba4647c9e service nova] Creating event network-vif-plugged:bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 for instance 5be536dd-61f5-4a17-a734-029b25739a47 on user Apr 12 00:30:29 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-a1f1e601-36fa-4063-87e5-f577688167a2 req-7dea4bd6-2792-4e22-8642-9ffba4647c9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040832 Apr 12 00:30:29 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 31/94] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:30:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:30:30 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-e074b4c5-c974-407b-855d-2bbc5fa3398f req-63d24e18-4628-41a5-8755-76f246d151ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db3a1291-c686-4e29-8499-8d49dd74a7bb", "tag": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:30 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-e074b4c5-c974-407b-855d-2bbc5fa3398f req-63d24e18-4628-41a5-8755-76f246d151ea service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:30 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-e074b4c5-c974-407b-855d-2bbc5fa3398f req-63d24e18-4628-41a5-8755-76f246d151ea service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:30 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-e074b4c5-c974-407b-855d-2bbc5fa3398f req-63d24e18-4628-41a5-8755-76f246d151ea service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:30 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-e074b4c5-c974-407b-855d-2bbc5fa3398f req-63d24e18-4628-41a5-8755-76f246d151ea service nova] Creating event network-changed:7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed for instance db3a1291-c686-4e29-8499-8d49dd74a7bb on user Apr 12 00:30:30 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-e074b4c5-c974-407b-855d-2bbc5fa3398f req-63d24e18-4628-41a5-8755-76f246d151ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075521 Apr 12 00:30:30 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 33/95] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:30:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:30:31 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-8a669244-0a5e-4543-8230-6f50ee1521bc req-03a043dc-15f7-428f-98a2-77563eeb17fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be536dd-61f5-4a17-a734-029b25739a47", "name": "network-vif-plugged", "status": "completed", "tag": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8a669244-0a5e-4543-8230-6f50ee1521bc req-03a043dc-15f7-428f-98a2-77563eeb17fb service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8a669244-0a5e-4543-8230-6f50ee1521bc req-03a043dc-15f7-428f-98a2-77563eeb17fb service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8a669244-0a5e-4543-8230-6f50ee1521bc req-03a043dc-15f7-428f-98a2-77563eeb17fb service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:31 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-8a669244-0a5e-4543-8230-6f50ee1521bc req-03a043dc-15f7-428f-98a2-77563eeb17fb service nova] Creating event network-vif-plugged:bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 for instance 5be536dd-61f5-4a17-a734-029b25739a47 on user Apr 12 00:30:31 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-8a669244-0a5e-4543-8230-6f50ee1521bc req-03a043dc-15f7-428f-98a2-77563eeb17fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053557 Apr 12 00:30:31 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 32/96] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:30:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:30:32 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-5de064c5-0062-4281-b3a4-0f658813934d req-dc5b8024-fb65-41d8-a3bb-c2234c529e48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9dc12da-4db1-4305-93ea-2bd63870c097", "tag": "47b92afd-7a5c-49a0-aea8-abccac5e350c"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:32 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-5de064c5-0062-4281-b3a4-0f658813934d req-dc5b8024-fb65-41d8-a3bb-c2234c529e48 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:32 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-5de064c5-0062-4281-b3a4-0f658813934d req-dc5b8024-fb65-41d8-a3bb-c2234c529e48 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:32 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-5de064c5-0062-4281-b3a4-0f658813934d req-dc5b8024-fb65-41d8-a3bb-c2234c529e48 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:32 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-5de064c5-0062-4281-b3a4-0f658813934d req-dc5b8024-fb65-41d8-a3bb-c2234c529e48 service nova] Creating event network-changed:47b92afd-7a5c-49a0-aea8-abccac5e350c for instance f9dc12da-4db1-4305-93ea-2bd63870c097 on user Apr 12 00:30:32 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-5de064c5-0062-4281-b3a4-0f658813934d req-dc5b8024-fb65-41d8-a3bb-c2234c529e48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043299 Apr 12 00:30:32 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 32/97] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:30:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:30:32 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-da0f2fd0-05ee-411f-bfe3-04e246d0a17e req-1123d189-0afd-493e-9176-5629b293fd6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db3a1291-c686-4e29-8499-8d49dd74a7bb", "name": "network-vif-plugged", "status": "completed", "tag": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-da0f2fd0-05ee-411f-bfe3-04e246d0a17e req-1123d189-0afd-493e-9176-5629b293fd6f service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-da0f2fd0-05ee-411f-bfe3-04e246d0a17e req-1123d189-0afd-493e-9176-5629b293fd6f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-da0f2fd0-05ee-411f-bfe3-04e246d0a17e req-1123d189-0afd-493e-9176-5629b293fd6f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:33 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-da0f2fd0-05ee-411f-bfe3-04e246d0a17e req-1123d189-0afd-493e-9176-5629b293fd6f service nova] Creating event network-vif-plugged:7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed for instance db3a1291-c686-4e29-8499-8d49dd74a7bb on user Apr 12 00:30:33 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-da0f2fd0-05ee-411f-bfe3-04e246d0a17e req-1123d189-0afd-493e-9176-5629b293fd6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050103 Apr 12 00:30:33 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 34/98] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:30:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:30:33 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-5d4e70a2-6a17-468d-937c-41b1b35ecdd0 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:33 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-5d4e70a2-6a17-468d-937c-41b1b35ecdd0 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:30:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5d4e70a2-6a17-468d-937c-41b1b35ecdd0 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5d4e70a2-6a17-468d-937c-41b1b35ecdd0 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5d4e70a2-6a17-468d-937c-41b1b35ecdd0 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5d4e70a2-6a17-468d-937c-41b1b35ecdd0 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5d4e70a2-6a17-468d-937c-41b1b35ecdd0 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5d4e70a2-6a17-468d-937c-41b1b35ecdd0 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:34 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-5d4e70a2-6a17-468d-937c-41b1b35ecdd0 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920d6d79e38e45fcb5153e712605764f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee31cdc6f4e4c2b9a8ec1e1c5076010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:30:34 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-5d4e70a2-6a17-468d-937c-41b1b35ecdd0 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" status: 200 len: 1493 microversion: 2.1 time: 0.561220 Apr 12 00:30:34 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 33/99] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:30:33 2023] GET /compute/v2.1/servers/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 => generated 1493 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:35 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-91673d55-6935-4d93-891b-910a12ed3cdc req-b3454c53-64b6-411d-a642-eaf2dbd69794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db3a1291-c686-4e29-8499-8d49dd74a7bb", "name": "network-vif-plugged", "status": "completed", "tag": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-91673d55-6935-4d93-891b-910a12ed3cdc req-b3454c53-64b6-411d-a642-eaf2dbd69794 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-91673d55-6935-4d93-891b-910a12ed3cdc req-b3454c53-64b6-411d-a642-eaf2dbd69794 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-91673d55-6935-4d93-891b-910a12ed3cdc req-b3454c53-64b6-411d-a642-eaf2dbd69794 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:35 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-91673d55-6935-4d93-891b-910a12ed3cdc req-b3454c53-64b6-411d-a642-eaf2dbd69794 service nova] Creating event network-vif-plugged:7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed for instance db3a1291-c686-4e29-8499-8d49dd74a7bb on user Apr 12 00:30:35 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=4 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:30:35 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=12 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:30:35 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-91673d55-6935-4d93-891b-910a12ed3cdc req-b3454c53-64b6-411d-a642-eaf2dbd69794 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.243354 Apr 12 00:30:35 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 33/100] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:30:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:30:37 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-d13afdcd-810d-4612-89f3-3b136f783fa3 req-631dd91a-dc83-464b-99f5-9915b88f4fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9dc12da-4db1-4305-93ea-2bd63870c097", "name": "network-vif-plugged", "status": "completed", "tag": "47b92afd-7a5c-49a0-aea8-abccac5e350c"}, {"server_uuid": "f9dc12da-4db1-4305-93ea-2bd63870c097", "name": "network-vif-plugged", "status": "completed", "tag": "47b92afd-7a5c-49a0-aea8-abccac5e350c"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d13afdcd-810d-4612-89f3-3b136f783fa3 req-631dd91a-dc83-464b-99f5-9915b88f4fa4 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d13afdcd-810d-4612-89f3-3b136f783fa3 req-631dd91a-dc83-464b-99f5-9915b88f4fa4 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d13afdcd-810d-4612-89f3-3b136f783fa3 req-631dd91a-dc83-464b-99f5-9915b88f4fa4 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:37 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-d13afdcd-810d-4612-89f3-3b136f783fa3 req-631dd91a-dc83-464b-99f5-9915b88f4fa4 service nova] Creating event network-vif-plugged:47b92afd-7a5c-49a0-aea8-abccac5e350c for instance f9dc12da-4db1-4305-93ea-2bd63870c097 on user Apr 12 00:30:37 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-d13afdcd-810d-4612-89f3-3b136f783fa3 req-631dd91a-dc83-464b-99f5-9915b88f4fa4 service nova] Creating event network-vif-plugged:47b92afd-7a5c-49a0-aea8-abccac5e350c for instance f9dc12da-4db1-4305-93ea-2bd63870c097 on user Apr 12 00:30:37 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-d13afdcd-810d-4612-89f3-3b136f783fa3 req-631dd91a-dc83-464b-99f5-9915b88f4fa4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038446 Apr 12 00:30:37 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 35/101] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:30:37 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:30:40 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=10 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:30:40 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-1e98b891-c427-49db-88f5-4d4d98156334 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:40 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-1e98b891-c427-49db-88f5-4d4d98156334 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:30:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1e98b891-c427-49db-88f5-4d4d98156334 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1e98b891-c427-49db-88f5-4d4d98156334 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1e98b891-c427-49db-88f5-4d4d98156334 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1e98b891-c427-49db-88f5-4d4d98156334 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1e98b891-c427-49db-88f5-4d4d98156334 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1e98b891-c427-49db-88f5-4d4d98156334 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:40 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-1e98b891-c427-49db-88f5-4d4d98156334 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9421443b2f421298a934122c6a8b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf1fea74ef143e6b394e41e7c4ed495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:30:40 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-1e98b891-c427-49db-88f5-4d4d98156334 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" status: 200 len: 1504 microversion: 2.1 time: 0.397534 Apr 12 00:30:40 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 34/102] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:30:40 2023] GET /compute/v2.1/servers/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 => generated 1504 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:43 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-d6d4ef40-df59-4377-835c-c8ecdc02f707 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Action: 'create', calling method: .version_select at 0x7f7cd4c5da20>, body: {"keypair": {"name": "tempest-keypair-803644994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzBx/jN7/lwZM70sS2akCkyoBcfWbS1VurrPOrxna0tELMf139PbMp4b7JxSHDzeEb40okiRs42LQg8dQWQSE996AvX+qsjLtEQj7201mlGlBduKysCZKDiabcGPzwx/g=="}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:43 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-d6d4ef40-df59-4377-835c-c8ecdc02f707 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Getting quotas for project c45d99a301794a748dadf4c96860835c. Resources: {'key_pairs'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:30:43 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-d6d4ef40-df59-4377-835c-c8ecdc02f707 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Getting quotas for user 846fa2a73bbb4036ad3fb19afc811131 and project c45d99a301794a748dadf4c96860835c. Resources: {'key_pairs'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:30:43 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-d6d4ef40-df59-4377-835c-c8ecdc02f707 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.168843 Apr 12 00:30:43 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 34/103] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 00:30:43 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 172 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 00:30:45 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:30:45 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=14 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:30:45 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1572227016", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "f93a64f7-abf3-4107-9031-b3707a5ffdb2"}, {"port": "02d77b15-fb16-44e3-9c20-d319e7302449", "tag": "port-1"}, {"port": "6903c204-8c47-4dbf-991d-28e91739df40", "tag": "port-2"}, {"uuid": "77337857-32d2-403b-b63a-c3c2db169526", "tag": "net-1"}, {"uuid": "77337857-32d2-403b-b63a-c3c2db169526"}, {"uuid": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "461419cd-f897-4bc9-b9a4-d0a23f965f34", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "b952b7bd-63f1-4f96-be7e-f66be254c652", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "68781ad8-f1c7-4aa8-8698-e079ecdea5a4", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "07d78963-38c7-4866-9bf0-26eafb026b18", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1634782266"}], "key_name": "tempest-keypair-803644994", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:45 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-b2aee6d0-9240-48ad-a70e-7d8a71af8990 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Action: 'create', calling method: .version_select at 0x7f7cd54a6dd0>, body: {"keypair": {"name": "tempest-keypair-2004337280", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8i4OR5UZaQZETcUvSLJ+H5m9K6iVODGf/iw+PVgSPLzAdo+Tu39IunsXfIAPFXZXi4L7BTe68iiJ2DUpGY9dH7xG9b7tCE+3w7bf8TbUeAS8/eILX6BKWXY0SUteJCdQ=="}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:45 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-b2aee6d0-9240-48ad-a70e-7d8a71af8990 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Getting quotas for project b6b2a25677e14a23ae7b81e2e56c008a. Resources: {'key_pairs'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:30:45 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-b2aee6d0-9240-48ad-a70e-7d8a71af8990 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Getting quotas for user df6b3a1f732c47e1aaa08b26056695d3 and project b6b2a25677e14a23ae7b81e2e56c008a. Resources: {'key_pairs'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:30:45 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-b2aee6d0-9240-48ad-a70e-7d8a71af8990 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.069189 Apr 12 00:30:45 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 35/104] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 00:30:45 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 00:30:45 user devstack@n-api.service[72496]: DEBUG nova.network.neutron [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] validate_networks() for [('f93a64f7-abf3-4107-9031-b3707a5ffdb2', None, None, None, None, None), (None, None, '02d77b15-fb16-44e3-9c20-d319e7302449', None, None, None), (None, None, '6903c204-8c47-4dbf-991d-28e91739df40', None, None, None), ('77337857-32d2-403b-b63a-c3c2db169526', None, None, None, None, None), ('77337857-32d2-403b-b63a-c3c2db169526', None, None, None, None, None), ('461419cd-f897-4bc9-b9a4-d0a23f965f34', '10.2.2.100', None, None, None, None), ('461419cd-f897-4bc9-b9a4-d0a23f965f34', '10.2.2.200', None, None, None, None)] {{(pid=72496) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:30:47 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=8 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:30:47 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=12 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:30:47 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-320a0db0-8aa3-45bb-a069-6dd319d814f1 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:47 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-320a0db0-8aa3-45bb-a069-6dd319d814f1 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:30:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-320a0db0-8aa3-45bb-a069-6dd319d814f1 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-320a0db0-8aa3-45bb-a069-6dd319d814f1 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-320a0db0-8aa3-45bb-a069-6dd319d814f1 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-320a0db0-8aa3-45bb-a069-6dd319d814f1 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-320a0db0-8aa3-45bb-a069-6dd319d814f1 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-320a0db0-8aa3-45bb-a069-6dd319d814f1 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:48 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-320a0db0-8aa3-45bb-a069-6dd319d814f1 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:30:48 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-320a0db0-8aa3-45bb-a069-6dd319d814f1 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 200 len: 1540 microversion: 2.1 time: 0.836984 Apr 12 00:30:48 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 35/105] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:30:47 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 1540 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:30:49 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1045274061", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "e45ac6be-a614-418d-afda-8428738f541e"}, {"port": "0b6ea381-2a40-4f39-a8a5-88a31565ea17", "tag": "port-1"}, {"port": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb", "tag": "port-2"}, {"uuid": "4434dbb7-595f-44b7-8e1b-d9197b4801f7", "tag": "net-1"}, {"uuid": "4434dbb7-595f-44b7-8e1b-d9197b4801f7"}, {"uuid": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "f9a3e3a0-6218-4c97-bde2-ecd1947cafd5", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c85736f3-0744-49a3-a4b9-c65987e67df4", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1830706227"}], "key_name": "tempest-keypair-2004337280", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:49 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:30:49 user devstack@n-api.service[72495]: DEBUG nova.network.neutron [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] validate_networks() for [('e45ac6be-a614-418d-afda-8428738f541e', None, None, None, None, None), (None, None, '0b6ea381-2a40-4f39-a8a5-88a31565ea17', None, None, None), (None, None, '8d5703b7-ffc6-4337-9cbe-98328e04c0eb', None, None, None), ('4434dbb7-595f-44b7-8e1b-d9197b4801f7', None, None, None, None, None), ('4434dbb7-595f-44b7-8e1b-d9197b4801f7', None, None, None, None, None), ('f9a3e3a0-6218-4c97-bde2-ecd1947cafd5', '10.2.2.100', None, None, None, None), ('f9a3e3a0-6218-4c97-bde2-ecd1947cafd5', '10.2.2.200', None, None, None, None)] {{(pid=72495) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:30:50 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Flavor limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:30:50 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Image limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:30:50 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Flavor pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:30:50 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Image pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:30:50 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:30:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:50 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=14 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:30:50 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Getting quotas for project c45d99a301794a748dadf4c96860835c. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:30:50 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Getting quotas for user 846fa2a73bbb4036ad3fb19afc811131 and project c45d99a301794a748dadf4c96860835c. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:30:50 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Going to run 1 instances... {{(pid=72496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:30:50 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='b952b7bd-63f1-4f96-be7e-f66be254c652',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='68781ad8-f1c7-4aa8-8698-e079ecdea5a4',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='07d78963-38c7-4866-9bf0-26eafb026b18',volume_size=None,volume_type=None)] {{(pid=72496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:30:51 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=5 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:30:51 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-015afd26-2314-40fa-abd3-9a1279499207 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 5.606094 Apr 12 00:30:51 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 36/106] 10.0.0.210 () {66 vars in 1266 bytes} [Wed Apr 12 00:30:45 2023] POST /compute/v2.1/servers => generated 404 bytes in 5608 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 00:30:51 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-795155fa-64b6-4210-83c7-92b79bf13412 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:51 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-795155fa-64b6-4210-83c7-92b79bf13412 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:30:51 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-795155fa-64b6-4210-83c7-92b79bf13412 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846fa2a73bbb4036ad3fb19afc811131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45d99a301794a748dadf4c96860835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:30:51 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-795155fa-64b6-4210-83c7-92b79bf13412 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '846fa2a73bbb4036ad3fb19afc811131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45d99a301794a748dadf4c96860835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:30:51 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-795155fa-64b6-4210-83c7-92b79bf13412 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '846fa2a73bbb4036ad3fb19afc811131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45d99a301794a748dadf4c96860835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:30:51 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-795155fa-64b6-4210-83c7-92b79bf13412 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3b52368-86be-4211-a37b-522ed3991a00" status: 200 len: 1279 microversion: 2.42 time: 0.158417 Apr 12 00:30:51 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 36/107] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:30:51 2023] GET /compute/v2.1/servers/e3b52368-86be-4211-a37b-522ed3991a00 => generated 1279 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:52 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Flavor limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:30:52 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Image limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:30:52 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Flavor pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:30:52 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Image pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:30:52 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:30:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:52 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Getting quotas for project b6b2a25677e14a23ae7b81e2e56c008a. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:30:52 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Getting quotas for user df6b3a1f732c47e1aaa08b26056695d3 and project b6b2a25677e14a23ae7b81e2e56c008a. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:30:53 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Going to run 1 instances... {{(pid=72495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:30:53 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='b1f1fd6b-92c7-4a0e-b0ed-a8c638ae03d0',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c85736f3-0744-49a3-a4b9-c65987e67df4',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7b972c95-1d1e-4e6d-8c0f-939b6ef86bd5',volume_size=None,volume_type=None)] {{(pid=72495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:30:53 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-2e687e17-810e-48bb-8d4c-6c97ff1e78aa tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 4.354198 Apr 12 00:30:53 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 36/108] 10.0.0.210 () {66 vars in 1266 bytes} [Wed Apr 12 00:30:49 2023] POST /compute/v2.1/servers => generated 404 bytes in 4355 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 00:30:53 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-29d3b9cb-84e2-4dd9-a7e9-6580a9dd8c85 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:53 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-29d3b9cb-84e2-4dd9-a7e9-6580a9dd8c85 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:30:53 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-29d3b9cb-84e2-4dd9-a7e9-6580a9dd8c85 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6b3a1f732c47e1aaa08b26056695d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b2a25677e14a23ae7b81e2e56c008a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:30:53 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-29d3b9cb-84e2-4dd9-a7e9-6580a9dd8c85 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df6b3a1f732c47e1aaa08b26056695d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b2a25677e14a23ae7b81e2e56c008a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:30:53 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-29d3b9cb-84e2-4dd9-a7e9-6580a9dd8c85 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df6b3a1f732c47e1aaa08b26056695d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b2a25677e14a23ae7b81e2e56c008a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:30:53 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-29d3b9cb-84e2-4dd9-a7e9-6580a9dd8c85 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f784806a-987f-4861-a23a-dbf961c8b6c1" status: 200 len: 1280 microversion: 2.32 time: 0.120747 Apr 12 00:30:53 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 37/109] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:30:53 2023] GET /compute/v2.1/servers/f784806a-987f-4861-a23a-dbf961c8b6c1 => generated 1280 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:30:56 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-839730056", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "1addebe1-54e0-40c1-ba5e-42b125ecbe37", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "159bca51-de37-4d87-9af5-ec97816a869c"}]}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:57 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-d870895a-d083-4578-8d61-88011480fdb7 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Action: 'create', calling method: .version_select at 0x7f7cd4b0d750>, body: {"keypair": {"name": "tempest-TestStampPattern-1883128824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+lqBLUO1k82hGcgtCe+lgTxswkJDIhSV+46anJZbLcEt4xsKUYhZkRHvrLN4Wi5w+S6ulWeowJ81Ej1Astt0Oq5E/DGISkMkyfqoTKb3WW9njRInUXCPv6XWrGG79l/A=="}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:30:57 user devstack@n-api.service[72495]: DEBUG nova.network.neutron [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] validate_networks() for [('159bca51-de37-4d87-9af5-ec97816a869c', None, None, None, None, None)] {{(pid=72495) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:30:57 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=7 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:30:57 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-d870895a-d083-4578-8d61-88011480fdb7 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Getting quotas for project ca0ea21a2d4d400cba79444c68b58aed. Resources: {'key_pairs'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:30:57 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-d870895a-d083-4578-8d61-88011480fdb7 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Getting quotas for user 0e843a45549943cb88b1b3123a2fbe8a and project ca0ea21a2d4d400cba79444c68b58aed. Resources: {'key_pairs'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:30:57 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-d870895a-d083-4578-8d61-88011480fdb7 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.264775 Apr 12 00:30:57 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 37/110] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 00:30:56 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:30:58 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flavor limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:30:58 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Image limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:30:58 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flavor pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:30:58 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Image pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:30:58 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:30:58 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:58 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:58 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:58 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:30:58 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:30:58 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:30:58 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting quotas for project e38a98bf1d964ee6bd2d0d05e97a283a. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:30:58 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting quotas for user c479f6ae2f0d40908be9b07717ca3509 and project e38a98bf1d964ee6bd2d0d05e97a283a. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:30:58 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Going to run 1 instances... {{(pid=72495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:30:58 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='1addebe1-54e0-40c1-ba5e-42b125ecbe37',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:30:58 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-e4a0fb75-1809-43cc-90de-970334c5091e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.230748 Apr 12 00:30:58 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 37/111] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:30:56 2023] POST /compute/v2.1/servers => generated 378 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:30:58 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-ba71c1cd-4821-497b-b6ab-eeb950628d07 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:30:58 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-ba71c1cd-4821-497b-b6ab-eeb950628d07 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:30:58 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-ba71c1cd-4821-497b-b6ab-eeb950628d07 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:30:58 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-ba71c1cd-4821-497b-b6ab-eeb950628d07 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f1f85bf-03e5-493e-b187-955998b020ee" status: 200 len: 1051 microversion: 2.1 time: 0.098824 Apr 12 00:30:58 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 38/112] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:30:58 2023] GET /compute/v2.1/servers/7f1f85bf-03e5-493e-b187-955998b020ee => generated 1051 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:01 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=6 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:31:01 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-0800fb2c-c734-4169-a7b0-4c634e2d66ae req-34b8ec98-1daf-440b-8b27-b9fc00386803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f1f85bf-03e5-493e-b187-955998b020ee", "tag": "b987249f-523f-4356-bdc9-82518d86209b"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-0800fb2c-c734-4169-a7b0-4c634e2d66ae req-34b8ec98-1daf-440b-8b27-b9fc00386803 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-0800fb2c-c734-4169-a7b0-4c634e2d66ae req-34b8ec98-1daf-440b-8b27-b9fc00386803 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-0800fb2c-c734-4169-a7b0-4c634e2d66ae req-34b8ec98-1daf-440b-8b27-b9fc00386803 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:01 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-0800fb2c-c734-4169-a7b0-4c634e2d66ae req-34b8ec98-1daf-440b-8b27-b9fc00386803 service nova] Creating event network-changed:b987249f-523f-4356-bdc9-82518d86209b for instance 7f1f85bf-03e5-493e-b187-955998b020ee on user Apr 12 00:31:01 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-0800fb2c-c734-4169-a7b0-4c634e2d66ae req-34b8ec98-1daf-440b-8b27-b9fc00386803 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041656 Apr 12 00:31:01 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 38/113] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:02 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1196189311", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1883128824", "security_groups": [{"name": "tempest-secgroup-smoke-518855564"}], "networks": [{"uuid": "193a75a6-a349-4ef2-9598-e9d4b3c476c4"}]}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:02 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-a44d4694-bd72-417b-ae32-1ca562c5d380 req-78226b2f-47fe-436d-a6e9-022a5390622e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "tag": "ad31f866-7d58-49a8-9e24-17ec4ad04a48"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:02 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:31:02 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:31:02 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-a44d4694-bd72-417b-ae32-1ca562c5d380 req-78226b2f-47fe-436d-a6e9-022a5390622e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:02 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-a44d4694-bd72-417b-ae32-1ca562c5d380 req-78226b2f-47fe-436d-a6e9-022a5390622e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:02 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-a44d4694-bd72-417b-ae32-1ca562c5d380 req-78226b2f-47fe-436d-a6e9-022a5390622e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:02 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-a44d4694-bd72-417b-ae32-1ca562c5d380 req-78226b2f-47fe-436d-a6e9-022a5390622e service nova] Creating event network-changed:ad31f866-7d58-49a8-9e24-17ec4ad04a48 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:31:02 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-a44d4694-bd72-417b-ae32-1ca562c5d380 req-78226b2f-47fe-436d-a6e9-022a5390622e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051412 Apr 12 00:31:02 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 39/114] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:03 user devstack@n-api.service[72495]: DEBUG nova.network.neutron [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] validate_networks() for [('193a75a6-a349-4ef2-9598-e9d4b3c476c4', None, None, None, None, None)] {{(pid=72495) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:31:04 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Flavor limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:31:04 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Image limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:31:04 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Flavor pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:31:04 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Image pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:31:04 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:31:04 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:04 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:04 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:04 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:04 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:04 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:04 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Getting quotas for project ca0ea21a2d4d400cba79444c68b58aed. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:31:04 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Getting quotas for user 0e843a45549943cb88b1b3123a2fbe8a and project ca0ea21a2d4d400cba79444c68b58aed. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:31:04 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Going to run 1 instances... {{(pid=72495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:31:04 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:31:04 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-30b2998d-cb25-4051-a02b-bfa316ca1f8c tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.299953 Apr 12 00:31:04 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 38/115] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:31:02 2023] POST /compute/v2.1/servers => generated 403 bytes in 1302 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:31:04 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-0bc7ac3f-e8f6-4d07-9c37-5c6a6db24e93 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:04 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-0bc7ac3f-e8f6-4d07-9c37-5c6a6db24e93 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:31:04 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-0bc7ac3f-e8f6-4d07-9c37-5c6a6db24e93 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e843a45549943cb88b1b3123a2fbe8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0ea21a2d4d400cba79444c68b58aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:31:04 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-0bc7ac3f-e8f6-4d07-9c37-5c6a6db24e93 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749" status: 200 len: 1237 microversion: 2.1 time: 0.140157 Apr 12 00:31:04 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 39/116] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:31:04 2023] GET /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749 => generated 1237 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:31:04 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-bf66a27a-19a2-45df-ae35-d0b5d9b299c0 req-a4700466-661c-4490-b7b2-4c2f292c5507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "tag": "02d77b15-fb16-44e3-9c20-d319e7302449"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-bf66a27a-19a2-45df-ae35-d0b5d9b299c0 req-a4700466-661c-4490-b7b2-4c2f292c5507 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-bf66a27a-19a2-45df-ae35-d0b5d9b299c0 req-a4700466-661c-4490-b7b2-4c2f292c5507 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-bf66a27a-19a2-45df-ae35-d0b5d9b299c0 req-a4700466-661c-4490-b7b2-4c2f292c5507 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:04 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-bf66a27a-19a2-45df-ae35-d0b5d9b299c0 req-a4700466-661c-4490-b7b2-4c2f292c5507 service nova] Creating event network-changed:02d77b15-fb16-44e3-9c20-d319e7302449 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:31:04 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-bf66a27a-19a2-45df-ae35-d0b5d9b299c0 req-a4700466-661c-4490-b7b2-4c2f292c5507 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050890 Apr 12 00:31:04 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 40/117] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:06 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-fba16692-7f84-4c5e-8eee-38e0239c6cbc req-896767cf-5467-4d61-b624-5790f501fad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "tag": "09b82fec-ca71-4934-ac24-073ca9080c9c"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:06 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-fba16692-7f84-4c5e-8eee-38e0239c6cbc req-896767cf-5467-4d61-b624-5790f501fad8 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:06 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-fba16692-7f84-4c5e-8eee-38e0239c6cbc req-896767cf-5467-4d61-b624-5790f501fad8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:06 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-fba16692-7f84-4c5e-8eee-38e0239c6cbc req-896767cf-5467-4d61-b624-5790f501fad8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:06 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-fba16692-7f84-4c5e-8eee-38e0239c6cbc req-896767cf-5467-4d61-b624-5790f501fad8 service nova] Creating event network-changed:09b82fec-ca71-4934-ac24-073ca9080c9c for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:31:06 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-fba16692-7f84-4c5e-8eee-38e0239c6cbc req-896767cf-5467-4d61-b624-5790f501fad8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053621 Apr 12 00:31:06 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 39/118] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:06 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-d55636c9-6db5-43ee-b94a-403e717bc630 req-2fa00959-4a3e-4082-864e-d82c2fe71794 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "tag": "6903c204-8c47-4dbf-991d-28e91739df40"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:06 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-d55636c9-6db5-43ee-b94a-403e717bc630 req-2fa00959-4a3e-4082-864e-d82c2fe71794 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:06 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-d55636c9-6db5-43ee-b94a-403e717bc630 req-2fa00959-4a3e-4082-864e-d82c2fe71794 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:06 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-d55636c9-6db5-43ee-b94a-403e717bc630 req-2fa00959-4a3e-4082-864e-d82c2fe71794 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:07 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-d55636c9-6db5-43ee-b94a-403e717bc630 req-2fa00959-4a3e-4082-864e-d82c2fe71794 service nova] Creating event network-changed:6903c204-8c47-4dbf-991d-28e91739df40 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:31:07 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-d55636c9-6db5-43ee-b94a-403e717bc630 req-2fa00959-4a3e-4082-864e-d82c2fe71794 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037027 Apr 12 00:31:07 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 40/119] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:08 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-6ac418cf-0303-4163-b783-52aaf0e5ea8f req-364c206c-c1bd-489b-951c-ecfbafba217a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25bc2e7-3399-47be-b78d-990acbb51749", "tag": "7f434880-804b-43da-b1ab-5d5e05b5bee1"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-6ac418cf-0303-4163-b783-52aaf0e5ea8f req-364c206c-c1bd-489b-951c-ecfbafba217a service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-6ac418cf-0303-4163-b783-52aaf0e5ea8f req-364c206c-c1bd-489b-951c-ecfbafba217a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-6ac418cf-0303-4163-b783-52aaf0e5ea8f req-364c206c-c1bd-489b-951c-ecfbafba217a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:08 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-6ac418cf-0303-4163-b783-52aaf0e5ea8f req-364c206c-c1bd-489b-951c-ecfbafba217a service nova] Creating event network-changed:7f434880-804b-43da-b1ab-5d5e05b5bee1 for instance d25bc2e7-3399-47be-b78d-990acbb51749 on user Apr 12 00:31:08 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-6ac418cf-0303-4163-b783-52aaf0e5ea8f req-364c206c-c1bd-489b-951c-ecfbafba217a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047121 Apr 12 00:31:08 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 41/120] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:08 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-fc671fb1-eb0c-4ef5-befb-20fe054c547b req-3173a759-5ad4-4707-bf5a-9417d1aa9336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "tag": "0b6ea381-2a40-4f39-a8a5-88a31565ea17"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-fc671fb1-eb0c-4ef5-befb-20fe054c547b req-3173a759-5ad4-4707-bf5a-9417d1aa9336 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-fc671fb1-eb0c-4ef5-befb-20fe054c547b req-3173a759-5ad4-4707-bf5a-9417d1aa9336 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-fc671fb1-eb0c-4ef5-befb-20fe054c547b req-3173a759-5ad4-4707-bf5a-9417d1aa9336 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:08 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-fc671fb1-eb0c-4ef5-befb-20fe054c547b req-3173a759-5ad4-4707-bf5a-9417d1aa9336 service nova] Creating event network-changed:0b6ea381-2a40-4f39-a8a5-88a31565ea17 for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:31:08 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-fc671fb1-eb0c-4ef5-befb-20fe054c547b req-3173a759-5ad4-4707-bf5a-9417d1aa9336 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079698 Apr 12 00:31:08 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 40/121] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:09 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-38c1710a-bea1-410c-b50f-3ad962942499 req-52f2ab8e-93e5-4ee4-9e74-369000aad4f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "tag": "b9c15342-4557-47ce-a9ed-4c378fe66186"}, {"name": "network-changed", "server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "tag": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-38c1710a-bea1-410c-b50f-3ad962942499 req-52f2ab8e-93e5-4ee4-9e74-369000aad4f8 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-38c1710a-bea1-410c-b50f-3ad962942499 req-52f2ab8e-93e5-4ee4-9e74-369000aad4f8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-38c1710a-bea1-410c-b50f-3ad962942499 req-52f2ab8e-93e5-4ee4-9e74-369000aad4f8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:09 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-38c1710a-bea1-410c-b50f-3ad962942499 req-52f2ab8e-93e5-4ee4-9e74-369000aad4f8 service nova] Creating event network-changed:b9c15342-4557-47ce-a9ed-4c378fe66186 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:31:09 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-38c1710a-bea1-410c-b50f-3ad962942499 req-52f2ab8e-93e5-4ee4-9e74-369000aad4f8 service nova] Creating event network-changed:b09d545e-e05d-42e0-b1d4-46fe7d8a6e46 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:31:09 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-38c1710a-bea1-410c-b50f-3ad962942499 req-52f2ab8e-93e5-4ee4-9e74-369000aad4f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037375 Apr 12 00:31:09 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 41/122] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:09 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:10 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=10 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:31:10 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-0011ed45-d5f0-4d0a-a8d1-c5b4b70eccbc req-f0a2aedf-4825-4539-92bd-3c7e9c1da1fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25bc2e7-3399-47be-b78d-990acbb51749", "name": "network-vif-plugged", "status": "completed", "tag": "7f434880-804b-43da-b1ab-5d5e05b5bee1"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:10 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-0011ed45-d5f0-4d0a-a8d1-c5b4b70eccbc req-f0a2aedf-4825-4539-92bd-3c7e9c1da1fc service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:10 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-0011ed45-d5f0-4d0a-a8d1-c5b4b70eccbc req-f0a2aedf-4825-4539-92bd-3c7e9c1da1fc service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:10 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-0011ed45-d5f0-4d0a-a8d1-c5b4b70eccbc req-f0a2aedf-4825-4539-92bd-3c7e9c1da1fc service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:10 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-0011ed45-d5f0-4d0a-a8d1-c5b4b70eccbc req-f0a2aedf-4825-4539-92bd-3c7e9c1da1fc service nova] Creating event network-vif-plugged:7f434880-804b-43da-b1ab-5d5e05b5bee1 for instance d25bc2e7-3399-47be-b78d-990acbb51749 on user Apr 12 00:31:10 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-0011ed45-d5f0-4d0a-a8d1-c5b4b70eccbc req-f0a2aedf-4825-4539-92bd-3c7e9c1da1fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072546 Apr 12 00:31:10 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 42/123] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:11 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-e322f52c-2139-426f-a4f7-df4432e3c6ad req-41bfa332-5f34-4034-9170-839b341f444e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "tag": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:11 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-e322f52c-2139-426f-a4f7-df4432e3c6ad req-41bfa332-5f34-4034-9170-839b341f444e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:11 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-e322f52c-2139-426f-a4f7-df4432e3c6ad req-41bfa332-5f34-4034-9170-839b341f444e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:11 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-e322f52c-2139-426f-a4f7-df4432e3c6ad req-41bfa332-5f34-4034-9170-839b341f444e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:11 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-e322f52c-2139-426f-a4f7-df4432e3c6ad req-41bfa332-5f34-4034-9170-839b341f444e service nova] Creating event network-changed:8d5703b7-ffc6-4337-9cbe-98328e04c0eb for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:31:11 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-e322f52c-2139-426f-a4f7-df4432e3c6ad req-41bfa332-5f34-4034-9170-839b341f444e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050740 Apr 12 00:31:11 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 41/124] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:12 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-5b1799eb-9d67-4840-b94b-02f2bbe2a7db req-ba5a2549-0ee6-4bed-8dd4-ba4567939a2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "tag": "34faa1f7-7c0e-4272-a3b6-092979dd46b8"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:12 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-5b1799eb-9d67-4840-b94b-02f2bbe2a7db req-ba5a2549-0ee6-4bed-8dd4-ba4567939a2c service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:12 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-5b1799eb-9d67-4840-b94b-02f2bbe2a7db req-ba5a2549-0ee6-4bed-8dd4-ba4567939a2c service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:12 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-5b1799eb-9d67-4840-b94b-02f2bbe2a7db req-ba5a2549-0ee6-4bed-8dd4-ba4567939a2c service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:12 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-5b1799eb-9d67-4840-b94b-02f2bbe2a7db req-ba5a2549-0ee6-4bed-8dd4-ba4567939a2c service nova] Creating event network-changed:34faa1f7-7c0e-4272-a3b6-092979dd46b8 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:31:12 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-5b1799eb-9d67-4840-b94b-02f2bbe2a7db req-ba5a2549-0ee6-4bed-8dd4-ba4567939a2c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037310 Apr 12 00:31:12 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 42/125] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:12 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-190cd6f5-70a4-4ed4-97f7-fc69c2822686 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:12 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-190cd6f5-70a4-4ed4-97f7-fc69c2822686 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:31:12 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-190cd6f5-70a4-4ed4-97f7-fc69c2822686 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:12 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-190cd6f5-70a4-4ed4-97f7-fc69c2822686 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:12 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-190cd6f5-70a4-4ed4-97f7-fc69c2822686 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:12 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-190cd6f5-70a4-4ed4-97f7-fc69c2822686 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:12 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-190cd6f5-70a4-4ed4-97f7-fc69c2822686 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:12 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-190cd6f5-70a4-4ed4-97f7-fc69c2822686 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:12 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-190cd6f5-70a4-4ed4-97f7-fc69c2822686 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4edaa34382341fd8f99f9d0921d80b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff88f0df3414610858ecf3d60295c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:31:12 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-190cd6f5-70a4-4ed4-97f7-fc69c2822686 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47" status: 200 len: 1524 microversion: 2.1 time: 0.426893 Apr 12 00:31:12 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 43/126] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:31:12 2023] GET /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47 => generated 1524 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:13 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-3aaa77a4-dab6-4013-b9b3-31ea0e7c44e7 req-936398e1-5c8b-4469-b0c0-f8d4a194b148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25bc2e7-3399-47be-b78d-990acbb51749", "name": "network-vif-plugged", "status": "completed", "tag": "7f434880-804b-43da-b1ab-5d5e05b5bee1"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:13 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3aaa77a4-dab6-4013-b9b3-31ea0e7c44e7 req-936398e1-5c8b-4469-b0c0-f8d4a194b148 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:13 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3aaa77a4-dab6-4013-b9b3-31ea0e7c44e7 req-936398e1-5c8b-4469-b0c0-f8d4a194b148 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:13 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3aaa77a4-dab6-4013-b9b3-31ea0e7c44e7 req-936398e1-5c8b-4469-b0c0-f8d4a194b148 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:13 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-3aaa77a4-dab6-4013-b9b3-31ea0e7c44e7 req-936398e1-5c8b-4469-b0c0-f8d4a194b148 service nova] Creating event network-vif-plugged:7f434880-804b-43da-b1ab-5d5e05b5bee1 for instance d25bc2e7-3399-47be-b78d-990acbb51749 on user Apr 12 00:31:13 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-3aaa77a4-dab6-4013-b9b3-31ea0e7c44e7 req-936398e1-5c8b-4469-b0c0-f8d4a194b148 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049036 Apr 12 00:31:13 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 42/127] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:14 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=12 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:31:14 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-544d2b6f-ecba-4e97-91a9-3762e0406b3c req-41d4864d-d5fd-4d2e-af3c-4707ae8da6c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f1f85bf-03e5-493e-b187-955998b020ee", "name": "network-vif-plugged", "status": "completed", "tag": "b987249f-523f-4356-bdc9-82518d86209b"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-544d2b6f-ecba-4e97-91a9-3762e0406b3c req-41d4864d-d5fd-4d2e-af3c-4707ae8da6c3 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-544d2b6f-ecba-4e97-91a9-3762e0406b3c req-41d4864d-d5fd-4d2e-af3c-4707ae8da6c3 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-544d2b6f-ecba-4e97-91a9-3762e0406b3c req-41d4864d-d5fd-4d2e-af3c-4707ae8da6c3 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:14 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-544d2b6f-ecba-4e97-91a9-3762e0406b3c req-41d4864d-d5fd-4d2e-af3c-4707ae8da6c3 service nova] Creating event network-vif-plugged:b987249f-523f-4356-bdc9-82518d86209b for instance 7f1f85bf-03e5-493e-b187-955998b020ee on user Apr 12 00:31:14 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-544d2b6f-ecba-4e97-91a9-3762e0406b3c req-41d4864d-d5fd-4d2e-af3c-4707ae8da6c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032932 Apr 12 00:31:14 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 43/128] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:15 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:31:15 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=22 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:31:15 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-10e91305-5e00-44ba-97bd-801a33c1e6e4 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:15 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-10e91305-5e00-44ba-97bd-801a33c1e6e4 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:31:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-10e91305-5e00-44ba-97bd-801a33c1e6e4 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-10e91305-5e00-44ba-97bd-801a33c1e6e4 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-10e91305-5e00-44ba-97bd-801a33c1e6e4 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-10e91305-5e00-44ba-97bd-801a33c1e6e4 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-10e91305-5e00-44ba-97bd-801a33c1e6e4 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-10e91305-5e00-44ba-97bd-801a33c1e6e4 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:15 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-b21c6cfd-6471-40cd-8255-897f3b95d795 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Action: 'create', calling method: .version_select at 0x7f7cd54cd120>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1604911239", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFP1c5/DXHZ03s6Jdn9okYMn378SHeUgFUdyzdwxHtCPGziXx0bIkFiht3GzYK2UQV1ksfRO+sxkDOUgz1Da1rC/+VwIe2/nk+J4nKbMkEnpWPIkQxI6eGb5x1NRAtYWkw=="}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:15 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-10e91305-5e00-44ba-97bd-801a33c1e6e4 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe897a730b44bb8c8bf9d92938bc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cf7bd87e954fa892ea0da5332a6589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:31:15 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-b21c6cfd-6471-40cd-8255-897f3b95d795 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Getting quotas for project e12eca8b17b844a8821294ec9dd19de8. Resources: {'key_pairs'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:31:15 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-10e91305-5e00-44ba-97bd-801a33c1e6e4 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb" status: 200 len: 1548 microversion: 2.1 time: 0.207783 Apr 12 00:31:15 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-b21c6cfd-6471-40cd-8255-897f3b95d795 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Getting quotas for user c5219586e4e24c33a8cdf52c21d875bd and project e12eca8b17b844a8821294ec9dd19de8. Resources: {'key_pairs'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:31:15 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 43/129] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:31:15 2023] GET /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb => generated 1548 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:15 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-b21c6cfd-6471-40cd-8255-897f3b95d795 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.362846 Apr 12 00:31:15 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 44/130] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 00:31:15 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:16 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "tag": "bb8ab354-dbbc-4141-9499-5689ae95fb2f"}, {"name": "network-changed", "server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "tag": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6"}, {"server_uuid": "7f1f85bf-03e5-493e-b187-955998b020ee", "name": "network-vif-plugged", "status": "completed", "tag": "b987249f-523f-4356-bdc9-82518d86209b"}, {"name": "network-changed", "server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "tag": "f9be977e-033f-44cb-adda-1590a13ccbdb"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:16 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:16 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:16 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:16 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] Creating event network-changed:bb8ab354-dbbc-4141-9499-5689ae95fb2f for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:31:16 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] Creating event network-changed:4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:31:16 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] Creating event network-vif-plugged:b987249f-523f-4356-bdc9-82518d86209b for instance 7f1f85bf-03e5-493e-b187-955998b020ee on user Apr 12 00:31:16 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] Creating event network-changed:f9be977e-033f-44cb-adda-1590a13ccbdb for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:31:16 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-68b6316a-39a1-4d4b-8bdd-c4147875170b req-98165ae0-ee90-45fa-b88e-d47a342cd7c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 684 microversion: 2.1 time: 0.056133 Apr 12 00:31:16 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 44/131] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:16 2023] POST /compute/v2.1/os-server-external-events => generated 684 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:17 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-234273224", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1604911239", "security_groups": [{"name": "tempest-secgroup-smoke-965750913"}], "networks": [{"uuid": "74d37a9a-7159-40ca-818e-746e6ff2534f"}]}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:17 user devstack@n-api.service[72495]: DEBUG nova.network.neutron [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] validate_networks() for [('74d37a9a-7159-40ca-818e-746e6ff2534f', None, None, None, None, None)] {{(pid=72495) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:31:18 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-fc03f3a5-4f60-431f-95d5-978da1690d5b tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:18 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-fc03f3a5-4f60-431f-95d5-978da1690d5b tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:31:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fc03f3a5-4f60-431f-95d5-978da1690d5b tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fc03f3a5-4f60-431f-95d5-978da1690d5b tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fc03f3a5-4f60-431f-95d5-978da1690d5b tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fc03f3a5-4f60-431f-95d5-978da1690d5b tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fc03f3a5-4f60-431f-95d5-978da1690d5b tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fc03f3a5-4f60-431f-95d5-978da1690d5b tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:18 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-fc03f3a5-4f60-431f-95d5-978da1690d5b tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dae26de34e047b8b4fe08b2e56a4b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7abb0634c7c44699a5197b9876b612c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:31:18 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-fc03f3a5-4f60-431f-95d5-978da1690d5b tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3dae26de34e047b8b4fe08b2e56a4b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7abb0634c7c44699a5197b9876b612c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:31:18 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-fc03f3a5-4f60-431f-95d5-978da1690d5b tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3dae26de34e047b8b4fe08b2e56a4b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7abb0634c7c44699a5197b9876b612c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:31:18 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-fc03f3a5-4f60-431f-95d5-978da1690d5b tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097" status: 200 len: 1627 microversion: 2.49 time: 0.343685 Apr 12 00:31:18 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 45/132] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:31:18 2023] GET /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097 => generated 1627 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:31:18 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Flavor limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:31:18 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Image limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:31:18 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Flavor pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:31:18 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Image pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:31:18 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:31:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:18 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Getting quotas for project e12eca8b17b844a8821294ec9dd19de8. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:31:18 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-7a65e485-827a-4bc7-8004-d5807887c2e4 req-af6aea5a-7298-41ed-a128-e9b1aaeb96b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "tag": "f528d725-8cc8-49c2-8e45-56340893e4c7"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:18 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Getting quotas for user c5219586e4e24c33a8cdf52c21d875bd and project e12eca8b17b844a8821294ec9dd19de8. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:31:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-7a65e485-827a-4bc7-8004-d5807887c2e4 req-af6aea5a-7298-41ed-a128-e9b1aaeb96b4 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-7a65e485-827a-4bc7-8004-d5807887c2e4 req-af6aea5a-7298-41ed-a128-e9b1aaeb96b4 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:18 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Going to run 1 instances... {{(pid=72495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:31:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-7a65e485-827a-4bc7-8004-d5807887c2e4 req-af6aea5a-7298-41ed-a128-e9b1aaeb96b4 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:18 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:31:18 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-7a65e485-827a-4bc7-8004-d5807887c2e4 req-af6aea5a-7298-41ed-a128-e9b1aaeb96b4 service nova] Creating event network-changed:f528d725-8cc8-49c2-8e45-56340893e4c7 for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:31:18 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-7a65e485-827a-4bc7-8004-d5807887c2e4 req-af6aea5a-7298-41ed-a128-e9b1aaeb96b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054998 Apr 12 00:31:18 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 45/133] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:18 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-c5cf9612-b4bd-4692-946a-fa78c68c9c01 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.978851 Apr 12 00:31:18 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 44/134] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:31:17 2023] POST /compute/v2.1/servers => generated 403 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:31:18 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-fe349a31-d6ab-4880-bd58-8918cd6defc0 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:18 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-fe349a31-d6ab-4880-bd58-8918cd6defc0 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:31:18 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-fe349a31-d6ab-4880-bd58-8918cd6defc0 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5219586e4e24c33a8cdf52c21d875bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12eca8b17b844a8821294ec9dd19de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:31:18 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-fe349a31-d6ab-4880-bd58-8918cd6defc0 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34" status: 200 len: 1256 microversion: 2.1 time: 0.097601 Apr 12 00:31:18 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 46/135] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:31:18 2023] GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34 => generated 1256 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:20 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-c96ea1e5-70f1-4f96-86cd-1dca8d077f72 req-986292ff-cb0c-40cd-acaf-244013e276b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "tag": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-c96ea1e5-70f1-4f96-86cd-1dca8d077f72 req-986292ff-cb0c-40cd-acaf-244013e276b0 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-c96ea1e5-70f1-4f96-86cd-1dca8d077f72 req-986292ff-cb0c-40cd-acaf-244013e276b0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-c96ea1e5-70f1-4f96-86cd-1dca8d077f72 req-986292ff-cb0c-40cd-acaf-244013e276b0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:20 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-c96ea1e5-70f1-4f96-86cd-1dca8d077f72 req-986292ff-cb0c-40cd-acaf-244013e276b0 service nova] Creating event network-changed:9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:31:20 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-c96ea1e5-70f1-4f96-86cd-1dca8d077f72 req-986292ff-cb0c-40cd-acaf-244013e276b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086154 Apr 12 00:31:20 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 46/136] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:22 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-5c4a949b-200b-48b6-ac63-a23af6e636e9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Action: 'create', calling method: .version_select at 0x7f7cd5666c20>, body: {"keypair": {"name": "tempest-TestShelveInstance-382306594", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAGdsPc2kkKFJoMoObq2mhf3wSWiVrIpEKF85Yl7zW57cuaGGXxZfMd81KN/RMSzVQbf9duu6jwp+9gjp4UDunIsZZRYk1GjUolkdqpAK7Qa3hIBA+9wz/IhHmwfXa5Kg=="}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:22 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=12 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:31:22 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-5c4a949b-200b-48b6-ac63-a23af6e636e9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Getting quotas for project b7bc7149e49343889c32fc198b6a0500. Resources: {'key_pairs'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:31:22 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-5c4a949b-200b-48b6-ac63-a23af6e636e9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Getting quotas for user 391e2cd0c34b4e838c4cf86ba933270c and project b7bc7149e49343889c32fc198b6a0500. Resources: {'key_pairs'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:31:22 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-5c4a949b-200b-48b6-ac63-a23af6e636e9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.156866 Apr 12 00:31:22 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 45/137] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 00:31:21 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:25 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-8a67aca9-c4ac-4fa5-9c06-4496b5224c5c req-8f7bfee8-312c-4892-8d58-6dfd6213b787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d67708d-1bcf-4d32-8d45-22376ec72e34", "tag": "71a3bef9-13f4-4aab-ba85-a26faa225efb"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:25 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=36 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:31:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-8a67aca9-c4ac-4fa5-9c06-4496b5224c5c req-8f7bfee8-312c-4892-8d58-6dfd6213b787 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-8a67aca9-c4ac-4fa5-9c06-4496b5224c5c req-8f7bfee8-312c-4892-8d58-6dfd6213b787 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-8a67aca9-c4ac-4fa5-9c06-4496b5224c5c req-8f7bfee8-312c-4892-8d58-6dfd6213b787 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:25 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-8a67aca9-c4ac-4fa5-9c06-4496b5224c5c req-8f7bfee8-312c-4892-8d58-6dfd6213b787 service nova] Creating event network-changed:71a3bef9-13f4-4aab-ba85-a26faa225efb for instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 on user Apr 12 00:31:25 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-8a67aca9-c4ac-4fa5-9c06-4496b5224c5c req-8f7bfee8-312c-4892-8d58-6dfd6213b787 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053795 Apr 12 00:31:25 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 47/138] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:26 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1609521830", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-382306594", "security_groups": [{"name": "tempest-secgroup-smoke-624536387"}], "networks": [{"uuid": "4ae2039c-a02a-41d7-bd01-139981504845"}], "block_device_mapping_v2": [{"uuid": "8d0a089d-f950-4c30-a68f-7511646878fb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:27 user devstack@n-api.service[72494]: DEBUG nova.network.neutron [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] validate_networks() for [('4ae2039c-a02a-41d7-bd01-139981504845', None, None, None, None, None)] {{(pid=72494) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:31:27 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:31:27 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Flavor limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:31:27 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Image limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:31:27 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Flavor pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:31:27 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Image pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:31:27 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:31:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:27 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Getting quotas for project b7bc7149e49343889c32fc198b6a0500. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:31:27 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Getting quotas for user 391e2cd0c34b4e838c4cf86ba933270c and project b7bc7149e49343889c32fc198b6a0500. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:31:27 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Going to run 1 instances... {{(pid=72494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:31:27 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8d0a089d-f950-4c30-a68f-7511646878fb',volume_size=None,volume_type=None)] {{(pid=72494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:31:28 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-5e58b124-3d65-4295-bd0a-72454db339a9 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.093868 Apr 12 00:31:28 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 47/139] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:31:26 2023] POST /compute/v2.1/servers => generated 403 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:31:28 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-8fc60c3a-53f6-43e1-b30b-427121813a02 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:28 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-8fc60c3a-53f6-43e1-b30b-427121813a02 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:31:28 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-8fc60c3a-53f6-43e1-b30b-427121813a02 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391e2cd0c34b4e838c4cf86ba933270c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bc7149e49343889c32fc198b6a0500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:31:28 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-8fc60c3a-53f6-43e1-b30b-427121813a02 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff" status: 200 len: 1083 microversion: 2.1 time: 0.099794 Apr 12 00:31:28 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 46/140] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:31:28 2023] GET /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff => generated 1083 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:29 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-6370d8e5-12b8-47a7-a880-ecfb2b011a50 req-39a567f3-ebec-452c-8f18-194daea44eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d67708d-1bcf-4d32-8d45-22376ec72e34", "name": "network-vif-plugged", "status": "completed", "tag": "71a3bef9-13f4-4aab-ba85-a26faa225efb"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:29 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:31:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-6370d8e5-12b8-47a7-a880-ecfb2b011a50 req-39a567f3-ebec-452c-8f18-194daea44eae service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-6370d8e5-12b8-47a7-a880-ecfb2b011a50 req-39a567f3-ebec-452c-8f18-194daea44eae service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-6370d8e5-12b8-47a7-a880-ecfb2b011a50 req-39a567f3-ebec-452c-8f18-194daea44eae service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:29 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-6370d8e5-12b8-47a7-a880-ecfb2b011a50 req-39a567f3-ebec-452c-8f18-194daea44eae service nova] Creating event network-vif-plugged:71a3bef9-13f4-4aab-ba85-a26faa225efb for instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 on user Apr 12 00:31:29 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-6370d8e5-12b8-47a7-a880-ecfb2b011a50 req-39a567f3-ebec-452c-8f18-194daea44eae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046303 Apr 12 00:31:29 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 48/141] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:31:30 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-d05faf82-e837-4b56-86dc-788ff828efea req-33717175-2bfc-44ad-b077-3db60344a133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-plugged", "status": "completed", "tag": "02d77b15-fb16-44e3-9c20-d319e7302449"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-d05faf82-e837-4b56-86dc-788ff828efea req-33717175-2bfc-44ad-b077-3db60344a133 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-d05faf82-e837-4b56-86dc-788ff828efea req-33717175-2bfc-44ad-b077-3db60344a133 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-d05faf82-e837-4b56-86dc-788ff828efea req-33717175-2bfc-44ad-b077-3db60344a133 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:30 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-d05faf82-e837-4b56-86dc-788ff828efea req-33717175-2bfc-44ad-b077-3db60344a133 service nova] Creating event network-vif-plugged:02d77b15-fb16-44e3-9c20-d319e7302449 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:31:30 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-d05faf82-e837-4b56-86dc-788ff828efea req-33717175-2bfc-44ad-b077-3db60344a133 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079914 Apr 12 00:31:30 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 48/142] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:31 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-3c06af89-326e-4c8e-870b-bf94a06a7372 req-06beb252-823c-4f2d-bcd9-b048b02d8c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-plugged", "status": "completed", "tag": "b9c15342-4557-47ce-a9ed-4c378fe66186"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:31 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:31:31 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=22 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:31:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3c06af89-326e-4c8e-870b-bf94a06a7372 req-06beb252-823c-4f2d-bcd9-b048b02d8c64 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3c06af89-326e-4c8e-870b-bf94a06a7372 req-06beb252-823c-4f2d-bcd9-b048b02d8c64 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3c06af89-326e-4c8e-870b-bf94a06a7372 req-06beb252-823c-4f2d-bcd9-b048b02d8c64 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:31 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-3c06af89-326e-4c8e-870b-bf94a06a7372 req-06beb252-823c-4f2d-bcd9-b048b02d8c64 service nova] Creating event network-vif-plugged:b9c15342-4557-47ce-a9ed-4c378fe66186 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:31:31 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-3c06af89-326e-4c8e-870b-bf94a06a7372 req-06beb252-823c-4f2d-bcd9-b048b02d8c64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066315 Apr 12 00:31:31 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 47/143] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:31:31 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d67708d-1bcf-4d32-8d45-22376ec72e34", "name": "network-vif-plugged", "status": "completed", "tag": "71a3bef9-13f4-4aab-ba85-a26faa225efb"}, {"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-plugged", "status": "completed", "tag": "ad31f866-7d58-49a8-9e24-17ec4ad04a48"}, {"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-plugged", "status": "completed", "tag": "ad31f866-7d58-49a8-9e24-17ec4ad04a48"}, {"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-plugged", "status": "completed", "tag": "6903c204-8c47-4dbf-991d-28e91739df40"}, {"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-plugged", "status": "completed", "tag": "6903c204-8c47-4dbf-991d-28e91739df40"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:31 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] Creating event network-vif-plugged:71a3bef9-13f4-4aab-ba85-a26faa225efb for instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 on user Apr 12 00:31:31 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] Creating event network-vif-plugged:ad31f866-7d58-49a8-9e24-17ec4ad04a48 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:31:31 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] Creating event network-vif-plugged:ad31f866-7d58-49a8-9e24-17ec4ad04a48 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:31:31 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] Creating event network-vif-plugged:6903c204-8c47-4dbf-991d-28e91739df40 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:31:31 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] Creating event network-vif-plugged:6903c204-8c47-4dbf-991d-28e91739df40 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:31:31 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-4cdac4e1-869b-443a-8d3e-44fd96bb63b8 req-5b9eab36-d21c-47db-a4f3-e63a14599445 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.125072 Apr 12 00:31:31 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 49/144] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:31 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:33 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-plugged", "status": "completed", "tag": "02d77b15-fb16-44e3-9c20-d319e7302449"}, {"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-plugged", "status": "completed", "tag": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6"}, {"name": "network-changed", "server_uuid": "19cc71e1-9b01-4bfd-9898-14b04bfe5fff", "tag": "b796ef8b-d964-459f-b12c-9be0133dd643"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:33 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=21 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:31:33 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] Creating event network-vif-plugged:02d77b15-fb16-44e3-9c20-d319e7302449 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:31:33 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] Creating event network-vif-plugged:4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:31:33 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] Creating event network-changed:b796ef8b-d964-459f-b12c-9be0133dd643 for instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff on user Apr 12 00:31:33 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-d3da8106-31a8-4393-a9a5-dfb49bea270c req-b52d3e0e-dc2d-4f08-8284-667cb0835193 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.041352 Apr 12 00:31:33 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 49/145] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:33 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:33 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-plugged", "status": "completed", "tag": "b9c15342-4557-47ce-a9ed-4c378fe66186"}, {"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-plugged", "status": "completed", "tag": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46"}, {"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-plugged", "status": "completed", "tag": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:33 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] Creating event network-vif-plugged:b9c15342-4557-47ce-a9ed-4c378fe66186 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:31:33 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] Creating event network-vif-plugged:b09d545e-e05d-42e0-b1d4-46fe7d8a6e46 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:31:33 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] Creating event network-vif-plugged:b09d545e-e05d-42e0-b1d4-46fe7d8a6e46 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:31:33 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-d1a17f63-f10d-4d45-870a-c8d62ade4f9c req-b5b1d94d-3b60-4a6a-b2a6-1197a5add827 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.054172 Apr 12 00:31:33 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 48/146] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:33 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:33 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-194aeec0-c0e8-4c5f-8908-75bb8c1f2563 req-3623f363-addf-4f9b-8df8-b5068b69fe1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-plugged", "status": "completed", "tag": "34faa1f7-7c0e-4272-a3b6-092979dd46b8"}, {"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-plugged", "status": "completed", "tag": "34faa1f7-7c0e-4272-a3b6-092979dd46b8"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-194aeec0-c0e8-4c5f-8908-75bb8c1f2563 req-3623f363-addf-4f9b-8df8-b5068b69fe1e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-194aeec0-c0e8-4c5f-8908-75bb8c1f2563 req-3623f363-addf-4f9b-8df8-b5068b69fe1e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-194aeec0-c0e8-4c5f-8908-75bb8c1f2563 req-3623f363-addf-4f9b-8df8-b5068b69fe1e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:33 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=27 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:31:34 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-194aeec0-c0e8-4c5f-8908-75bb8c1f2563 req-3623f363-addf-4f9b-8df8-b5068b69fe1e service nova] Creating event network-vif-plugged:34faa1f7-7c0e-4272-a3b6-092979dd46b8 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:31:34 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-194aeec0-c0e8-4c5f-8908-75bb8c1f2563 req-3623f363-addf-4f9b-8df8-b5068b69fe1e service nova] Creating event network-vif-plugged:34faa1f7-7c0e-4272-a3b6-092979dd46b8 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:31:34 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-194aeec0-c0e8-4c5f-8908-75bb8c1f2563 req-3623f363-addf-4f9b-8df8-b5068b69fe1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.330486 Apr 12 00:31:34 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 50/147] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:33 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:34 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-909783913", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "networks": [{"uuid": "4588d0e1-772f-4c76-b467-7e46031e477d"}]}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:34 user devstack@n-api.service[72494]: DEBUG nova.network.neutron [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] validate_networks() for [('4588d0e1-772f-4c76-b467-7e46031e477d', None, None, None, None, None)] {{(pid=72494) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:31:35 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-plugged", "status": "completed", "tag": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "09b82fec-ca71-4934-ac24-073ca9080c9c"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "09b82fec-ca71-4934-ac24-073ca9080c9c"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "0b6ea381-2a40-4f39-a8a5-88a31565ea17"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:35 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] Creating event network-vif-plugged:4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:31:35 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] Creating event network-vif-plugged:09b82fec-ca71-4934-ac24-073ca9080c9c for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:31:35 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] Creating event network-vif-plugged:09b82fec-ca71-4934-ac24-073ca9080c9c for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:31:35 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] Creating event network-vif-plugged:0b6ea381-2a40-4f39-a8a5-88a31565ea17 for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:31:35 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-a93ba7b2-64e1-40c2-8a67-a5456ab0ac27 req-f374de6a-a291-48ca-be01-9478869062aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.039600 Apr 12 00:31:35 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 49/148] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:35 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:35 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Flavor limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:31:35 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Image limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:31:35 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Flavor pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:31:35 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Image pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:31:35 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:31:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:35 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Getting quotas for project 6ee31cdc6f4e4c2b9a8ec1e1c5076010. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:31:35 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Getting quotas for user 920d6d79e38e45fcb5153e712605764f and project 6ee31cdc6f4e4c2b9a8ec1e1c5076010. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:31:35 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Going to run 1 instances... {{(pid=72494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:31:35 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:31:35 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-950e5516-6ea3-40a0-9be8-d53079bfa16f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.889189 Apr 12 00:31:35 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 50/149] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:31:34 2023] POST /compute/v2.1/servers => generated 378 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:31:35 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-073b4724-3913-4744-990d-e9f80316585f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:35 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-073b4724-3913-4744-990d-e9f80316585f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:31:35 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-47b89302-c91f-426b-96e5-24806a67a6ed req-95d820e2-4a54-42f1-b2f7-2261fb3927f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-47b89302-c91f-426b-96e5-24806a67a6ed req-95d820e2-4a54-42f1-b2f7-2261fb3927f3 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-47b89302-c91f-426b-96e5-24806a67a6ed req-95d820e2-4a54-42f1-b2f7-2261fb3927f3 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-47b89302-c91f-426b-96e5-24806a67a6ed req-95d820e2-4a54-42f1-b2f7-2261fb3927f3 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:35 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-073b4724-3913-4744-990d-e9f80316585f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920d6d79e38e45fcb5153e712605764f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee31cdc6f4e4c2b9a8ec1e1c5076010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:31:35 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-073b4724-3913-4744-990d-e9f80316585f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] 10.0.0.210 "GET /compute/v2.1/servers/570abef1-f803-4f3e-8051-b6f690063496" status: 200 len: 1210 microversion: 2.1 time: 0.189649 Apr 12 00:31:35 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 51/150] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:31:35 2023] GET /compute/v2.1/servers/570abef1-f803-4f3e-8051-b6f690063496 => generated 1210 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:35 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-47b89302-c91f-426b-96e5-24806a67a6ed req-95d820e2-4a54-42f1-b2f7-2261fb3927f3 service nova] Creating event network-vif-plugged:8d5703b7-ffc6-4337-9cbe-98328e04c0eb for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:31:35 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-47b89302-c91f-426b-96e5-24806a67a6ed req-95d820e2-4a54-42f1-b2f7-2261fb3927f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072643 Apr 12 00:31:35 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 50/151] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:37 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "0b6ea381-2a40-4f39-a8a5-88a31565ea17"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "bb8ab354-dbbc-4141-9499-5689ae95fb2f"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "bb8ab354-dbbc-4141-9499-5689ae95fb2f"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "f528d725-8cc8-49c2-8e45-56340893e4c7"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:37 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] Creating event network-vif-plugged:0b6ea381-2a40-4f39-a8a5-88a31565ea17 for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:31:37 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] Creating event network-vif-plugged:bb8ab354-dbbc-4141-9499-5689ae95fb2f for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:31:37 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] Creating event network-vif-plugged:bb8ab354-dbbc-4141-9499-5689ae95fb2f for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:31:37 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] Creating event network-vif-plugged:f528d725-8cc8-49c2-8e45-56340893e4c7 for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:31:37 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-1a43ec54-86e5-448c-8806-6146b4fa9321 req-9a692fee-35ba-47f7-93a8-eb321fd8295f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.054725 Apr 12 00:31:37 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 51/152] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:37 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:37 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "f9be977e-033f-44cb-adda-1590a13ccbdb"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "f9be977e-033f-44cb-adda-1590a13ccbdb"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:37 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] Creating event network-vif-plugged:8d5703b7-ffc6-4337-9cbe-98328e04c0eb for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:31:37 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] Creating event network-vif-plugged:f9be977e-033f-44cb-adda-1590a13ccbdb for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:31:37 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] Creating event network-vif-plugged:f9be977e-033f-44cb-adda-1590a13ccbdb for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:31:37 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-eeb21e2a-c208-4f67-97a3-0f818a83a324 req-2faed866-f3c3-4304-8846-334ed6507207 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.040511 Apr 12 00:31:37 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 52/153] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:37 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:39 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=12 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:31:39 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "f528d725-8cc8-49c2-8e45-56340893e4c7"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b"}, {"name": "network-changed", "server_uuid": "570abef1-f803-4f3e-8051-b6f690063496", "tag": "6e0b9ee8-e941-48ea-9659-8e837577d4bb"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:39 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] Creating event network-vif-plugged:f528d725-8cc8-49c2-8e45-56340893e4c7 for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:31:39 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] Creating event network-vif-plugged:9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:31:39 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] Creating event network-vif-plugged:9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:31:39 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] Creating event network-changed:6e0b9ee8-e941-48ea-9659-8e837577d4bb for instance 570abef1-f803-4f3e-8051-b6f690063496 on user Apr 12 00:31:39 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-f47912b6-4edf-4973-b570-8774eecaccac req-71b88001-8003-446e-82d4-94398bf8be12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 692 microversion: 2.1 time: 0.054706 Apr 12 00:31:39 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 51/154] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:39 2023] POST /compute/v2.1/os-server-external-events => generated 692 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:39 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-be21aad1-98c7-4173-a611-84240f9120a7 req-00a30585-e663-4a72-901c-623c05dcfb25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19cc71e1-9b01-4bfd-9898-14b04bfe5fff", "name": "network-vif-plugged", "status": "completed", "tag": "b796ef8b-d964-459f-b12c-9be0133dd643"}, {"server_uuid": "19cc71e1-9b01-4bfd-9898-14b04bfe5fff", "name": "network-vif-plugged", "status": "completed", "tag": "b796ef8b-d964-459f-b12c-9be0133dd643"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-be21aad1-98c7-4173-a611-84240f9120a7 req-00a30585-e663-4a72-901c-623c05dcfb25 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-be21aad1-98c7-4173-a611-84240f9120a7 req-00a30585-e663-4a72-901c-623c05dcfb25 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-be21aad1-98c7-4173-a611-84240f9120a7 req-00a30585-e663-4a72-901c-623c05dcfb25 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:39 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-be21aad1-98c7-4173-a611-84240f9120a7 req-00a30585-e663-4a72-901c-623c05dcfb25 service nova] Creating event network-vif-plugged:b796ef8b-d964-459f-b12c-9be0133dd643 for instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff on user Apr 12 00:31:39 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-be21aad1-98c7-4173-a611-84240f9120a7 req-00a30585-e663-4a72-901c-623c05dcfb25 service nova] Creating event network-vif-plugged:b796ef8b-d964-459f-b12c-9be0133dd643 for instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff on user Apr 12 00:31:39 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-be21aad1-98c7-4173-a611-84240f9120a7 req-00a30585-e663-4a72-901c-623c05dcfb25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041086 Apr 12 00:31:40 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 52/155] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:39 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:40 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:40 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:31:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:40 user devstack@n-api.service[72496]: DEBUG nova.objects.instance [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'flavor' on Instance uuid 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 {{(pid=72496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:31:40 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-d43f4a2c-046f-458c-88c7-4552e3592efb tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/action" status: 200 len: 32 microversion: 2.1 time: 0.238816 Apr 12 00:31:40 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 53/156] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 00:31:40 2023] POST /compute/v2.1/servers/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050/action => generated 32 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:31:40 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-00659e8e-c991-488f-bff5-3d2ca79023ec tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:40 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-00659e8e-c991-488f-bff5-3d2ca79023ec tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:31:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-00659e8e-c991-488f-bff5-3d2ca79023ec tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-00659e8e-c991-488f-bff5-3d2ca79023ec tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-00659e8e-c991-488f-bff5-3d2ca79023ec tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-00659e8e-c991-488f-bff5-3d2ca79023ec tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-00659e8e-c991-488f-bff5-3d2ca79023ec tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-00659e8e-c991-488f-bff5-3d2ca79023ec tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:41 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-00659e8e-c991-488f-bff5-3d2ca79023ec tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9421443b2f421298a934122c6a8b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf1fea74ef143e6b394e41e7c4ed495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:31:41 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-00659e8e-c991-488f-bff5-3d2ca79023ec tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" status: 200 len: 1510 microversion: 2.1 time: 0.214321 Apr 12 00:31:41 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 52/157] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:31:40 2023] GET /compute/v2.1/servers/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 => generated 1510 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:41 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-faaab1bf-63a8-4e01-8e72-9621c8e1eb1f tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:41 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-faaab1bf-63a8-4e01-8e72-9621c8e1eb1f tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:31:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-faaab1bf-63a8-4e01-8e72-9621c8e1eb1f tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-faaab1bf-63a8-4e01-8e72-9621c8e1eb1f tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-faaab1bf-63a8-4e01-8e72-9621c8e1eb1f tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-faaab1bf-63a8-4e01-8e72-9621c8e1eb1f tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-faaab1bf-63a8-4e01-8e72-9621c8e1eb1f tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-faaab1bf-63a8-4e01-8e72-9621c8e1eb1f tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:41 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-4f34561d-18d5-42ef-b2b8-96a73a9b33a3 req-7415839f-6b41-48ec-8ddd-8781c1a88e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570abef1-f803-4f3e-8051-b6f690063496", "name": "network-vif-plugged", "status": "completed", "tag": "6e0b9ee8-e941-48ea-9659-8e837577d4bb"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:41 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4f34561d-18d5-42ef-b2b8-96a73a9b33a3 req-7415839f-6b41-48ec-8ddd-8781c1a88e9a service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:41 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4f34561d-18d5-42ef-b2b8-96a73a9b33a3 req-7415839f-6b41-48ec-8ddd-8781c1a88e9a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:41 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4f34561d-18d5-42ef-b2b8-96a73a9b33a3 req-7415839f-6b41-48ec-8ddd-8781c1a88e9a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:41 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-4f34561d-18d5-42ef-b2b8-96a73a9b33a3 req-7415839f-6b41-48ec-8ddd-8781c1a88e9a service nova] Creating event network-vif-plugged:6e0b9ee8-e941-48ea-9659-8e837577d4bb for instance 570abef1-f803-4f3e-8051-b6f690063496 on user Apr 12 00:31:41 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-4f34561d-18d5-42ef-b2b8-96a73a9b33a3 req-7415839f-6b41-48ec-8ddd-8781c1a88e9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047155 Apr 12 00:31:41 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 54/158] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:41 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-faaab1bf-63a8-4e01-8e72-9621c8e1eb1f tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846fa2a73bbb4036ad3fb19afc811131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45d99a301794a748dadf4c96860835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:31:41 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-faaab1bf-63a8-4e01-8e72-9621c8e1eb1f tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '846fa2a73bbb4036ad3fb19afc811131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45d99a301794a748dadf4c96860835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:31:41 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-faaab1bf-63a8-4e01-8e72-9621c8e1eb1f tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '846fa2a73bbb4036ad3fb19afc811131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45d99a301794a748dadf4c96860835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:31:41 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-faaab1bf-63a8-4e01-8e72-9621c8e1eb1f tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3b52368-86be-4211-a37b-522ed3991a00" status: 200 len: 2828 microversion: 2.42 time: 0.358418 Apr 12 00:31:41 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 53/159] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:31:41 2023] GET /compute/v2.1/servers/e3b52368-86be-4211-a37b-522ed3991a00 => generated 2828 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:31:43 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-05740d3f-dcbb-44d5-b54a-385d69ea3f57 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:43 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-05740d3f-dcbb-44d5-b54a-385d69ea3f57 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:31:43 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-05740d3f-dcbb-44d5-b54a-385d69ea3f57 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:43 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-05740d3f-dcbb-44d5-b54a-385d69ea3f57 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:43 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-05740d3f-dcbb-44d5-b54a-385d69ea3f57 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:43 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-05740d3f-dcbb-44d5-b54a-385d69ea3f57 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:43 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-05740d3f-dcbb-44d5-b54a-385d69ea3f57 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:43 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-05740d3f-dcbb-44d5-b54a-385d69ea3f57 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:43 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570abef1-f803-4f3e-8051-b6f690063496", "name": "network-vif-plugged", "status": "completed", "tag": "6e0b9ee8-e941-48ea-9659-8e837577d4bb"}, {"server_uuid": "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050", "name": "network-vif-unplugged", "status": "completed", "tag": "8cb07b1c-aa00-4fcf-983c-4b42566ef948"}, {"server_uuid": "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050", "name": "network-vif-plugged", "status": "completed", "tag": "8cb07b1c-aa00-4fcf-983c-4b42566ef948"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:43 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-05740d3f-dcbb-44d5-b54a-385d69ea3f57 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6b3a1f732c47e1aaa08b26056695d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b2a25677e14a23ae7b81e2e56c008a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:31:43 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-05740d3f-dcbb-44d5-b54a-385d69ea3f57 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df6b3a1f732c47e1aaa08b26056695d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b2a25677e14a23ae7b81e2e56c008a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:31:43 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-05740d3f-dcbb-44d5-b54a-385d69ea3f57 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df6b3a1f732c47e1aaa08b26056695d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b2a25677e14a23ae7b81e2e56c008a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:31:43 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-05740d3f-dcbb-44d5-b54a-385d69ea3f57 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f784806a-987f-4861-a23a-dbf961c8b6c1" status: 200 len: 2823 microversion: 2.32 time: 0.310136 Apr 12 00:31:43 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 53/160] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:31:43 2023] GET /compute/v2.1/servers/f784806a-987f-4861-a23a-dbf961c8b6c1 => generated 2823 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:31:44 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] Creating event network-vif-plugged:6e0b9ee8-e941-48ea-9659-8e837577d4bb for instance 570abef1-f803-4f3e-8051-b6f690063496 on user Apr 12 00:31:44 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] Creating event network-vif-unplugged:8cb07b1c-aa00-4fcf-983c-4b42566ef948 for instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 on user Apr 12 00:31:44 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] Creating event network-vif-plugged:8cb07b1c-aa00-4fcf-983c-4b42566ef948 for instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 on user Apr 12 00:31:44 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-9fff2ec0-d773-4667-b9bf-e07dca556235 req-12163c4d-22e0-416b-9142-04b8d8a561f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.113996 Apr 12 00:31:44 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 55/161] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:43 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:46 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=4 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:31:46 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=12 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:31:46 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-d6a7f1e3-3929-4f46-9064-48e58c869173 req-a8120d61-d900-4906-9918-c58164fc7fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050", "name": "network-vif-plugged", "status": "completed", "tag": "8cb07b1c-aa00-4fcf-983c-4b42566ef948"}, {"server_uuid": "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050", "name": "network-vif-plugged", "status": "completed", "tag": "8cb07b1c-aa00-4fcf-983c-4b42566ef948"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:46 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-d6a7f1e3-3929-4f46-9064-48e58c869173 req-a8120d61-d900-4906-9918-c58164fc7fc5 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:46 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-d6a7f1e3-3929-4f46-9064-48e58c869173 req-a8120d61-d900-4906-9918-c58164fc7fc5 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:46 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-d6a7f1e3-3929-4f46-9064-48e58c869173 req-a8120d61-d900-4906-9918-c58164fc7fc5 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:46 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-d6a7f1e3-3929-4f46-9064-48e58c869173 req-a8120d61-d900-4906-9918-c58164fc7fc5 service nova] Creating event network-vif-plugged:8cb07b1c-aa00-4fcf-983c-4b42566ef948 for instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 on user Apr 12 00:31:46 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-d6a7f1e3-3929-4f46-9064-48e58c869173 req-a8120d61-d900-4906-9918-c58164fc7fc5 service nova] Creating event network-vif-plugged:8cb07b1c-aa00-4fcf-983c-4b42566ef948 for instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 on user Apr 12 00:31:46 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-d6a7f1e3-3929-4f46-9064-48e58c869173 req-a8120d61-d900-4906-9918-c58164fc7fc5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044098 Apr 12 00:31:46 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 54/162] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:48 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-94ec2087-95c8-4079-b248-c3f0a88a25c6 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:48 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-94ec2087-95c8-4079-b248-c3f0a88a25c6 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:31:48 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-94ec2087-95c8-4079-b248-c3f0a88a25c6 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:48 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-94ec2087-95c8-4079-b248-c3f0a88a25c6 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:48 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-94ec2087-95c8-4079-b248-c3f0a88a25c6 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:48 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-94ec2087-95c8-4079-b248-c3f0a88a25c6 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:48 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-94ec2087-95c8-4079-b248-c3f0a88a25c6 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:48 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-94ec2087-95c8-4079-b248-c3f0a88a25c6 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:48 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-94ec2087-95c8-4079-b248-c3f0a88a25c6 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:31:48 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-94ec2087-95c8-4079-b248-c3f0a88a25c6 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f1f85bf-03e5-493e-b187-955998b020ee" status: 200 len: 1378 microversion: 2.1 time: 0.190107 Apr 12 00:31:48 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 54/163] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:31:48 2023] GET /compute/v2.1/servers/7f1f85bf-03e5-493e-b187-955998b020ee => generated 1378 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:48 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:31:48 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-b8ed3539-09c5-44f5-8300-91d649fd5155 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:48 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-b8ed3539-09c5-44f5-8300-91d649fd5155 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:31:48 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b8ed3539-09c5-44f5-8300-91d649fd5155 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:48 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b8ed3539-09c5-44f5-8300-91d649fd5155 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:48 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b8ed3539-09c5-44f5-8300-91d649fd5155 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:48 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b8ed3539-09c5-44f5-8300-91d649fd5155 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:48 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b8ed3539-09c5-44f5-8300-91d649fd5155 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:48 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b8ed3539-09c5-44f5-8300-91d649fd5155 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:48 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-b8ed3539-09c5-44f5-8300-91d649fd5155 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.142573 Apr 12 00:31:48 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 56/164] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 00:31:48 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/os-interface => generated 283 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:50 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-4d029ec1-c7cc-474d-a6f6-efa81e2324c8 req-46feb81f-bc4f-4821-bdb8-cf38254c0a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbe6d6bc-65a6-469a-89a0-7e4c51620b14", "tag": "b99b54c2-0b21-42ea-91d0-087aa230da7e"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:31:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-4d029ec1-c7cc-474d-a6f6-efa81e2324c8 req-46feb81f-bc4f-4821-bdb8-cf38254c0a5e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-4d029ec1-c7cc-474d-a6f6-efa81e2324c8 req-46feb81f-bc4f-4821-bdb8-cf38254c0a5e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-4d029ec1-c7cc-474d-a6f6-efa81e2324c8 req-46feb81f-bc4f-4821-bdb8-cf38254c0a5e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:50 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-4d029ec1-c7cc-474d-a6f6-efa81e2324c8 req-46feb81f-bc4f-4821-bdb8-cf38254c0a5e service nova] Creating event network-changed:b99b54c2-0b21-42ea-91d0-087aa230da7e for instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 on user Apr 12 00:31:50 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-4d029ec1-c7cc-474d-a6f6-efa81e2324c8 req-46feb81f-bc4f-4821-bdb8-cf38254c0a5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042891 Apr 12 00:31:50 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 55/165] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:31:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:31:50 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-d21e2d60-4022-4ea1-bee4-4702da25b323 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:50 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-d21e2d60-4022-4ea1-bee4-4702da25b323 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:31:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d21e2d60-4022-4ea1-bee4-4702da25b323 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d21e2d60-4022-4ea1-bee4-4702da25b323 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d21e2d60-4022-4ea1-bee4-4702da25b323 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d21e2d60-4022-4ea1-bee4-4702da25b323 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d21e2d60-4022-4ea1-bee4-4702da25b323 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d21e2d60-4022-4ea1-bee4-4702da25b323 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:50 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-d21e2d60-4022-4ea1-bee4-4702da25b323 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:31:50 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-d21e2d60-4022-4ea1-bee4-4702da25b323 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 200 len: 1540 microversion: 2.1 time: 0.185066 Apr 12 00:31:50 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 55/166] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:31:50 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 1540 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:50 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-72410fc5-09d5-49cd-9849-04e6cd2c3749 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:50 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-72410fc5-09d5-49cd-9849-04e6cd2c3749 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:31:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-72410fc5-09d5-49cd-9849-04e6cd2c3749 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-72410fc5-09d5-49cd-9849-04e6cd2c3749 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-72410fc5-09d5-49cd-9849-04e6cd2c3749 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-72410fc5-09d5-49cd-9849-04e6cd2c3749 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-72410fc5-09d5-49cd-9849-04e6cd2c3749 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-72410fc5-09d5-49cd-9849-04e6cd2c3749 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:50 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-72410fc5-09d5-49cd-9849-04e6cd2c3749 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:31:50 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-72410fc5-09d5-49cd-9849-04e6cd2c3749 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 200 len: 1540 microversion: 2.1 time: 0.231485 Apr 12 00:31:50 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 57/167] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:31:50 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 1540 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:31:54 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-aaf23549-e21c-4067-ab23-d1f1daf5af41 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:31:54 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-aaf23549-e21c-4067-ab23-d1f1daf5af41 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:31:54 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-aaf23549-e21c-4067-ab23-d1f1daf5af41 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:54 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-aaf23549-e21c-4067-ab23-d1f1daf5af41 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:54 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-aaf23549-e21c-4067-ab23-d1f1daf5af41 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:54 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-aaf23549-e21c-4067-ab23-d1f1daf5af41 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:31:54 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-aaf23549-e21c-4067-ab23-d1f1daf5af41 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:31:54 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-aaf23549-e21c-4067-ab23-d1f1daf5af41 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:31:54 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-aaf23549-e21c-4067-ab23-d1f1daf5af41 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e843a45549943cb88b1b3123a2fbe8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0ea21a2d4d400cba79444c68b58aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:31:54 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-aaf23549-e21c-4067-ab23-d1f1daf5af41 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749" status: 200 len: 1538 microversion: 2.1 time: 0.160229 Apr 12 00:31:54 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 56/168] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:31:54 2023] GET /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749 => generated 1538 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:08 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-ed5db35e-397e-4c64-822a-56d1af256f2d tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:08 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-ed5db35e-397e-4c64-822a-56d1af256f2d tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:08 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:32:08 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=34 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:32:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ed5db35e-397e-4c64-822a-56d1af256f2d tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ed5db35e-397e-4c64-822a-56d1af256f2d tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ed5db35e-397e-4c64-822a-56d1af256f2d tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ed5db35e-397e-4c64-822a-56d1af256f2d tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ed5db35e-397e-4c64-822a-56d1af256f2d tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ed5db35e-397e-4c64-822a-56d1af256f2d tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:09 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-ed5db35e-397e-4c64-822a-56d1af256f2d tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5219586e4e24c33a8cdf52c21d875bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12eca8b17b844a8821294ec9dd19de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:09 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-ed5db35e-397e-4c64-822a-56d1af256f2d tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34" status: 200 len: 1568 microversion: 2.1 time: 0.156439 Apr 12 00:32:09 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 56/169] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:32:08 2023] GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:12 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-324efd28-51b7-4cfb-8605-9a76ddc81eec tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:12 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-324efd28-51b7-4cfb-8605-9a76ddc81eec tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:12 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=23 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:32:12 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:32:12 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-324efd28-51b7-4cfb-8605-9a76ddc81eec tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:12 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-324efd28-51b7-4cfb-8605-9a76ddc81eec tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:12 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-324efd28-51b7-4cfb-8605-9a76ddc81eec tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:12 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-324efd28-51b7-4cfb-8605-9a76ddc81eec tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:12 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-324efd28-51b7-4cfb-8605-9a76ddc81eec tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:12 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-324efd28-51b7-4cfb-8605-9a76ddc81eec tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:13 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-324efd28-51b7-4cfb-8605-9a76ddc81eec tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.105546 Apr 12 00:32:13 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 58/170] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 00:32:12 2023] GET /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47/os-interface => generated 283 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:14 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-85516290-fa5e-43df-a7e4-451c31329723 req-85ae4ea2-bccc-4d70-a659-f2d30407ff9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5be536dd-61f5-4a17-a734-029b25739a47", "tag": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:14 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=6 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:32:14 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=23 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:32:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-85516290-fa5e-43df-a7e4-451c31329723 req-85ae4ea2-bccc-4d70-a659-f2d30407ff9b service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-85516290-fa5e-43df-a7e4-451c31329723 req-85ae4ea2-bccc-4d70-a659-f2d30407ff9b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-85516290-fa5e-43df-a7e4-451c31329723 req-85ae4ea2-bccc-4d70-a659-f2d30407ff9b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:14 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-85516290-fa5e-43df-a7e4-451c31329723 req-85ae4ea2-bccc-4d70-a659-f2d30407ff9b service nova] Creating event network-changed:bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 for instance 5be536dd-61f5-4a17-a734-029b25739a47 on user Apr 12 00:32:14 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-85516290-fa5e-43df-a7e4-451c31329723 req-85ae4ea2-bccc-4d70-a659-f2d30407ff9b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042196 Apr 12 00:32:14 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 57/171] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:14 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65678a70-1c74-42ac-9334-dd959c1ea80f"}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:14 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:15 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-cae1bd28-6220-4782-8b57-85d7e919afce tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.755826 Apr 12 00:32:15 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 57/172] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 00:32:14 2023] POST /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47/os-volume_attachments => generated 194 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:15 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-35372eb3-fb94-4c01-bf4d-436d3c6ea050 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:15 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-35372eb3-fb94-4c01-bf4d-436d3c6ea050 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:15 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-35372eb3-fb94-4c01-bf4d-436d3c6ea050 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:15 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-35372eb3-fb94-4c01-bf4d-436d3c6ea050 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:15 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-35372eb3-fb94-4c01-bf4d-436d3c6ea050 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:15 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-35372eb3-fb94-4c01-bf4d-436d3c6ea050 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:15 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-35372eb3-fb94-4c01-bf4d-436d3c6ea050 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:15 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-35372eb3-fb94-4c01-bf4d-436d3c6ea050 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:16 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-35372eb3-fb94-4c01-bf4d-436d3c6ea050 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.102762 Apr 12 00:32:16 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 59/173] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 00:32:15 2023] GET /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb/os-interface => generated 283 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:17 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-f3325009-e7a1-473f-92ec-951529a5367a req-fa7147c2-d8f8-415c-951f-77917a192393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db3a1291-c686-4e29-8499-8d49dd74a7bb", "tag": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:17 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f3325009-e7a1-473f-92ec-951529a5367a req-fa7147c2-d8f8-415c-951f-77917a192393 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:17 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f3325009-e7a1-473f-92ec-951529a5367a req-fa7147c2-d8f8-415c-951f-77917a192393 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:17 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f3325009-e7a1-473f-92ec-951529a5367a req-fa7147c2-d8f8-415c-951f-77917a192393 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:17 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-f3325009-e7a1-473f-92ec-951529a5367a req-fa7147c2-d8f8-415c-951f-77917a192393 service nova] Creating event network-changed:7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed for instance db3a1291-c686-4e29-8499-8d49dd74a7bb on user Apr 12 00:32:17 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-f3325009-e7a1-473f-92ec-951529a5367a req-fa7147c2-d8f8-415c-951f-77917a192393 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.279139 Apr 12 00:32:17 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 58/174] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:18 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-2f91f0bf-188c-47a7-8a5e-424bf3bb3d69 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:18 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-2f91f0bf-188c-47a7-8a5e-424bf3bb3d69 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2f91f0bf-188c-47a7-8a5e-424bf3bb3d69 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2f91f0bf-188c-47a7-8a5e-424bf3bb3d69 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2f91f0bf-188c-47a7-8a5e-424bf3bb3d69 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2f91f0bf-188c-47a7-8a5e-424bf3bb3d69 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2f91f0bf-188c-47a7-8a5e-424bf3bb3d69 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2f91f0bf-188c-47a7-8a5e-424bf3bb3d69 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:18 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-2f91f0bf-188c-47a7-8a5e-424bf3bb3d69 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391e2cd0c34b4e838c4cf86ba933270c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bc7149e49343889c32fc198b6a0500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:18 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-2f91f0bf-188c-47a7-8a5e-424bf3bb3d69 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff" status: 200 len: 1432 microversion: 2.1 time: 0.198981 Apr 12 00:32:18 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 58/175] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:32:18 2023] GET /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff => generated 1432 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:18 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-bcd1e5cc-98f2-496c-b251-05db735fdcf7 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:18 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-bcd1e5cc-98f2-496c-b251-05db735fdcf7 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-bcd1e5cc-98f2-496c-b251-05db735fdcf7 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-bcd1e5cc-98f2-496c-b251-05db735fdcf7 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-bcd1e5cc-98f2-496c-b251-05db735fdcf7 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-bcd1e5cc-98f2-496c-b251-05db735fdcf7 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-bcd1e5cc-98f2-496c-b251-05db735fdcf7 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-bcd1e5cc-98f2-496c-b251-05db735fdcf7 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:18 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-bcd1e5cc-98f2-496c-b251-05db735fdcf7 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097/os-interface" status: 200 len: 283 microversion: 2.49 time: 0.096567 Apr 12 00:32:18 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 60/176] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 00:32:18 2023] GET /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097/os-interface => generated 283 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:32:18 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9921d0be-3070-4605-a1f0-eb4e10a6fb02"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:18 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:19 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-cb46af4e-36df-463d-aa11-c303e8d0c0ba tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] 10.0.0.210 "POST /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.454351 Apr 12 00:32:19 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 59/177] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 00:32:18 2023] POST /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb/os-volume_attachments => generated 194 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:20 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-5d251e39-e0b2-4b68-8f75-ce1f49f149e7 req-9570ddd2-b869-4876-b6c3-ad29c41b5ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9dc12da-4db1-4305-93ea-2bd63870c097", "tag": "47b92afd-7a5c-49a0-aea8-abccac5e350c"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:20 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-5d251e39-e0b2-4b68-8f75-ce1f49f149e7 req-9570ddd2-b869-4876-b6c3-ad29c41b5ff0 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:20 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-5d251e39-e0b2-4b68-8f75-ce1f49f149e7 req-9570ddd2-b869-4876-b6c3-ad29c41b5ff0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:20 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-5d251e39-e0b2-4b68-8f75-ce1f49f149e7 req-9570ddd2-b869-4876-b6c3-ad29c41b5ff0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:20 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-5d251e39-e0b2-4b68-8f75-ce1f49f149e7 req-9570ddd2-b869-4876-b6c3-ad29c41b5ff0 service nova] Creating event network-changed:47b92afd-7a5c-49a0-aea8-abccac5e350c for instance f9dc12da-4db1-4305-93ea-2bd63870c097 on user Apr 12 00:32:20 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-5d251e39-e0b2-4b68-8f75-ce1f49f149e7 req-9570ddd2-b869-4876-b6c3-ad29c41b5ff0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049716 Apr 12 00:32:20 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 59/178] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:20 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-3e1873d6-fe73-49a6-9898-e581aad29061 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:20 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-3e1873d6-fe73-49a6-9898-e581aad29061 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-3e1873d6-fe73-49a6-9898-e581aad29061 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-3e1873d6-fe73-49a6-9898-e581aad29061 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-3e1873d6-fe73-49a6-9898-e581aad29061 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-3e1873d6-fe73-49a6-9898-e581aad29061 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-3e1873d6-fe73-49a6-9898-e581aad29061 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-3e1873d6-fe73-49a6-9898-e581aad29061 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:20 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-3e1873d6-fe73-49a6-9898-e581aad29061 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dae26de34e047b8b4fe08b2e56a4b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7abb0634c7c44699a5197b9876b612c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:20 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-3e1873d6-fe73-49a6-9898-e581aad29061 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3dae26de34e047b8b4fe08b2e56a4b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7abb0634c7c44699a5197b9876b612c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:20 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-3e1873d6-fe73-49a6-9898-e581aad29061 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3dae26de34e047b8b4fe08b2e56a4b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7abb0634c7c44699a5197b9876b612c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:20 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-3e1873d6-fe73-49a6-9898-e581aad29061 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097" status: 200 len: 1627 microversion: 2.49 time: 0.232458 Apr 12 00:32:20 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 61/179] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:32:20 2023] GET /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097 => generated 1627 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:32:20 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "df07df70-1ed7-4b48-9b14-5be5c30e51b8", "tag": "nic-tag"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:20 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:22 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-06de061c-e74c-47fb-9fd6-25ad81e26241 req-2d123b53-8a72-4f35-a2d7-c860b52bd1e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9dc12da-4db1-4305-93ea-2bd63870c097", "tag": "27eab0c4-101d-46a5-a472-d7de01ee4f14"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:22 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-06de061c-e74c-47fb-9fd6-25ad81e26241 req-2d123b53-8a72-4f35-a2d7-c860b52bd1e6 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:22 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-06de061c-e74c-47fb-9fd6-25ad81e26241 req-2d123b53-8a72-4f35-a2d7-c860b52bd1e6 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:22 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-06de061c-e74c-47fb-9fd6-25ad81e26241 req-2d123b53-8a72-4f35-a2d7-c860b52bd1e6 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:22 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-06de061c-e74c-47fb-9fd6-25ad81e26241 req-2d123b53-8a72-4f35-a2d7-c860b52bd1e6 service nova] Creating event network-changed:27eab0c4-101d-46a5-a472-d7de01ee4f14 for instance f9dc12da-4db1-4305-93ea-2bd63870c097 on user Apr 12 00:32:22 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-06de061c-e74c-47fb-9fd6-25ad81e26241 req-2d123b53-8a72-4f35-a2d7-c860b52bd1e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040912 Apr 12 00:32:22 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 60/180] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:22 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "d3d5ecec-19dc-4989-a561-09ad5028728b"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:22 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:23 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-2758ba2e-9df0-42b6-a321-a7ca6ffc3901 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47/os-volume_attachments/65678a70-1c74-42ac-9334-dd959c1ea80f" status: 202 len: 0 microversion: 2.1 time: 0.675376 Apr 12 00:32:23 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 62/181] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 00:32:22 2023] PUT /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47/os-volume_attachments/65678a70-1c74-42ac-9334-dd959c1ea80f => generated 0 bytes in 678 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:32:24 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-359cc569-65d8-4308-b635-338d3118262e req-9ddabddc-0613-45df-94d1-0d9477e7609d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9dc12da-4db1-4305-93ea-2bd63870c097", "name": "network-vif-plugged", "status": "completed", "tag": "27eab0c4-101d-46a5-a472-d7de01ee4f14"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-359cc569-65d8-4308-b635-338d3118262e req-9ddabddc-0613-45df-94d1-0d9477e7609d service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-359cc569-65d8-4308-b635-338d3118262e req-9ddabddc-0613-45df-94d1-0d9477e7609d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-359cc569-65d8-4308-b635-338d3118262e req-9ddabddc-0613-45df-94d1-0d9477e7609d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:24 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-359cc569-65d8-4308-b635-338d3118262e req-9ddabddc-0613-45df-94d1-0d9477e7609d service nova] Creating event network-vif-plugged:27eab0c4-101d-46a5-a472-d7de01ee4f14 for instance f9dc12da-4db1-4305-93ea-2bd63870c097 on user Apr 12 00:32:24 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-359cc569-65d8-4308-b635-338d3118262e req-9ddabddc-0613-45df-94d1-0d9477e7609d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048278 Apr 12 00:32:24 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 61/182] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:24 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:24 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-8a8cd7aa-f009-4493-87a3-fb0c1f7c0a34 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097/os-interface" status: 200 len: 283 microversion: 2.49 time: 4.158838 Apr 12 00:32:24 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 60/183] 10.0.0.210 () {66 vars in 1414 bytes} [Wed Apr 12 00:32:20 2023] POST /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097/os-interface => generated 283 bytes in 4161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:32:24 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2052f02-80cb-4f9f-b9d6-e4525e872af4", "tag": "volume-tag"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:24 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:24 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:24 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:24 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:24 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:24 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:24 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:24 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-6edf5ddb-7b5b-4266-9eeb-dee596a0e70f tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.373084 Apr 12 00:32:24 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 63/184] 10.0.0.210 () {66 vars in 1441 bytes} [Wed Apr 12 00:32:24 2023] POST /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:32:25 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-4de8d686-0495-4ebb-a1e5-119eeaa8c20e tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:25 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-4de8d686-0495-4ebb-a1e5-119eeaa8c20e tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-4de8d686-0495-4ebb-a1e5-119eeaa8c20e tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-4de8d686-0495-4ebb-a1e5-119eeaa8c20e tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-4de8d686-0495-4ebb-a1e5-119eeaa8c20e tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-4de8d686-0495-4ebb-a1e5-119eeaa8c20e tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-4de8d686-0495-4ebb-a1e5-119eeaa8c20e tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-4de8d686-0495-4ebb-a1e5-119eeaa8c20e tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:26 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-4de8d686-0495-4ebb-a1e5-119eeaa8c20e tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920d6d79e38e45fcb5153e712605764f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee31cdc6f4e4c2b9a8ec1e1c5076010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:26 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-4de8d686-0495-4ebb-a1e5-119eeaa8c20e tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] 10.0.0.210 "GET /compute/v2.1/servers/570abef1-f803-4f3e-8051-b6f690063496" status: 200 len: 1492 microversion: 2.1 time: 0.165982 Apr 12 00:32:26 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 62/185] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:32:25 2023] GET /compute/v2.1/servers/570abef1-f803-4f3e-8051-b6f690063496 => generated 1492 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:26 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-c89b0112-b743-433e-9dab-61e83104fdf6 req-f77fad64-9d48-4bb3-9502-91ebd7c406b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9dc12da-4db1-4305-93ea-2bd63870c097", "name": "network-vif-plugged", "status": "completed", "tag": "27eab0c4-101d-46a5-a472-d7de01ee4f14"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-c89b0112-b743-433e-9dab-61e83104fdf6 req-f77fad64-9d48-4bb3-9502-91ebd7c406b8 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-c89b0112-b743-433e-9dab-61e83104fdf6 req-f77fad64-9d48-4bb3-9502-91ebd7c406b8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-c89b0112-b743-433e-9dab-61e83104fdf6 req-f77fad64-9d48-4bb3-9502-91ebd7c406b8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:26 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-c89b0112-b743-433e-9dab-61e83104fdf6 req-f77fad64-9d48-4bb3-9502-91ebd7c406b8 service nova] Creating event network-vif-plugged:27eab0c4-101d-46a5-a472-d7de01ee4f14 for instance f9dc12da-4db1-4305-93ea-2bd63870c097 on user Apr 12 00:32:26 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-c89b0112-b743-433e-9dab-61e83104fdf6 req-f77fad64-9d48-4bb3-9502-91ebd7c406b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029213 Apr 12 00:32:26 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 61/186] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-1921f671-1ceb-4672-af2e-7339ffc7dbf5 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:27 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-1921f671-1ceb-4672-af2e-7339ffc7dbf5 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1921f671-1ceb-4672-af2e-7339ffc7dbf5 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1921f671-1ceb-4672-af2e-7339ffc7dbf5 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1921f671-1ceb-4672-af2e-7339ffc7dbf5 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1921f671-1ceb-4672-af2e-7339ffc7dbf5 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1921f671-1ceb-4672-af2e-7339ffc7dbf5 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1921f671-1ceb-4672-af2e-7339ffc7dbf5 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:27 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-1921f671-1ceb-4672-af2e-7339ffc7dbf5 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042549 Apr 12 00:32:27 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 64/187] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:32:27 2023] GET /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:27 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:27 user devstack@n-api.service[72495]: DEBUG nova.objects.instance [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lazy-loading 'services' on Instance uuid db3a1291-c686-4e29-8499-8d49dd74a7bb {{(pid=72495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:32:27 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-dbea23d4-e586-4ead-b07d-c6bd18fae711 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb/os-volume_attachments/9921d0be-3070-4605-a1f0-eb4e10a6fb02" status: 202 len: 0 microversion: 2.1 time: 0.288740 Apr 12 00:32:27 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 63/188] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 00:32:27 2023] DELETE /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb/os-volume_attachments/9921d0be-3070-4605-a1f0-eb4e10a6fb02 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:32:29 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-97a1d405-af23-475e-b2c5-12dba1c27315 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:29 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-97a1d405-af23-475e-b2c5-12dba1c27315 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-97a1d405-af23-475e-b2c5-12dba1c27315 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-97a1d405-af23-475e-b2c5-12dba1c27315 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-97a1d405-af23-475e-b2c5-12dba1c27315 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-97a1d405-af23-475e-b2c5-12dba1c27315 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-97a1d405-af23-475e-b2c5-12dba1c27315 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-97a1d405-af23-475e-b2c5-12dba1c27315 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:29 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-97a1d405-af23-475e-b2c5-12dba1c27315 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047711 Apr 12 00:32:29 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 62/189] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:32:29 2023] GET /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:32:29 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-24cace46-77ae-4da9-bc6e-5345e598a3a2 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:29 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-24cace46-77ae-4da9-bc6e-5345e598a3a2 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-24cace46-77ae-4da9-bc6e-5345e598a3a2 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-24cace46-77ae-4da9-bc6e-5345e598a3a2 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-24cace46-77ae-4da9-bc6e-5345e598a3a2 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-24cace46-77ae-4da9-bc6e-5345e598a3a2 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-24cace46-77ae-4da9-bc6e-5345e598a3a2 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-24cace46-77ae-4da9-bc6e-5345e598a3a2 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:29 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-24cace46-77ae-4da9-bc6e-5345e598a3a2 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050217 Apr 12 00:32:29 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 65/190] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:32:29 2023] GET /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:32:29 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:29 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:29 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Going to try to terminate instance {{(pid=72495) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:32:29 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-ec1d492f-283e-459f-8a82-25bd43e3ebec tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb" status: 204 len: 0 microversion: 2.1 time: 0.146441 Apr 12 00:32:29 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 64/191] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:32:29 2023] DELETE /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:32:29 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-e220063b-46b1-4eb5-98b4-da20989f5f00 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:29 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-e220063b-46b1-4eb5-98b4-da20989f5f00 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e220063b-46b1-4eb5-98b4-da20989f5f00 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e220063b-46b1-4eb5-98b4-da20989f5f00 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e220063b-46b1-4eb5-98b4-da20989f5f00 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e220063b-46b1-4eb5-98b4-da20989f5f00 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e220063b-46b1-4eb5-98b4-da20989f5f00 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e220063b-46b1-4eb5-98b4-da20989f5f00 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:30 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-e220063b-46b1-4eb5-98b4-da20989f5f00 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe897a730b44bb8c8bf9d92938bc9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88cf7bd87e954fa892ea0da5332a6589', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:30 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-e220063b-46b1-4eb5-98b4-da20989f5f00 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb" status: 200 len: 1673 microversion: 2.1 time: 0.235018 Apr 12 00:32:30 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 63/192] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:32:29 2023] GET /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb => generated 1673 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:30 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-d1165755-c2d7-4de5-a9be-8720238d6688 req-bbfcc4d1-c6e3-49f1-a746-f7e82996042b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db3a1291-c686-4e29-8499-8d49dd74a7bb", "name": "network-vif-unplugged", "status": "completed", "tag": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:30 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d1165755-c2d7-4de5-a9be-8720238d6688 req-bbfcc4d1-c6e3-49f1-a746-f7e82996042b service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:30 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d1165755-c2d7-4de5-a9be-8720238d6688 req-bbfcc4d1-c6e3-49f1-a746-f7e82996042b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:30 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d1165755-c2d7-4de5-a9be-8720238d6688 req-bbfcc4d1-c6e3-49f1-a746-f7e82996042b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:30 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-d1165755-c2d7-4de5-a9be-8720238d6688 req-bbfcc4d1-c6e3-49f1-a746-f7e82996042b service nova] Creating event network-vif-unplugged:7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed for instance db3a1291-c686-4e29-8499-8d49dd74a7bb on user Apr 12 00:32:30 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-d1165755-c2d7-4de5-a9be-8720238d6688 req-bbfcc4d1-c6e3-49f1-a746-f7e82996042b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044209 Apr 12 00:32:30 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 66/193] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:31 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-99b8dfe3-f348-4e9f-bc65-cd54cc49c1c4 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:31 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-99b8dfe3-f348-4e9f-bc65-cd54cc49c1c4 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-99b8dfe3-f348-4e9f-bc65-cd54cc49c1c4 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-99b8dfe3-f348-4e9f-bc65-cd54cc49c1c4 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-99b8dfe3-f348-4e9f-bc65-cd54cc49c1c4 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-99b8dfe3-f348-4e9f-bc65-cd54cc49c1c4 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-99b8dfe3-f348-4e9f-bc65-cd54cc49c1c4 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-99b8dfe3-f348-4e9f-bc65-cd54cc49c1c4 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:31 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-99b8dfe3-f348-4e9f-bc65-cd54cc49c1c4 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9421443b2f421298a934122c6a8b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf1fea74ef143e6b394e41e7c4ed495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:31 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-99b8dfe3-f348-4e9f-bc65-cd54cc49c1c4 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" status: 200 len: 1490 microversion: 2.1 time: 0.236651 Apr 12 00:32:31 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 65/194] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:32:31 2023] GET /compute/v2.1/servers/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 => generated 1490 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:32 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-f3e0dd6a-1196-4de4-8ffa-42c77fd4a4e2 req-786475c5-f12c-4b7d-a237-84853a560f61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db3a1291-c686-4e29-8499-8d49dd74a7bb", "name": "network-vif-plugged", "status": "completed", "tag": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:32 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f3e0dd6a-1196-4de4-8ffa-42c77fd4a4e2 req-786475c5-f12c-4b7d-a237-84853a560f61 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:32 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f3e0dd6a-1196-4de4-8ffa-42c77fd4a4e2 req-786475c5-f12c-4b7d-a237-84853a560f61 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:32 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f3e0dd6a-1196-4de4-8ffa-42c77fd4a4e2 req-786475c5-f12c-4b7d-a237-84853a560f61 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:32 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-f3e0dd6a-1196-4de4-8ffa-42c77fd4a4e2 req-786475c5-f12c-4b7d-a237-84853a560f61 service nova] Creating event network-vif-plugged:7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed for instance db3a1291-c686-4e29-8499-8d49dd74a7bb on user Apr 12 00:32:32 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-f3e0dd6a-1196-4de4-8ffa-42c77fd4a4e2 req-786475c5-f12c-4b7d-a237-84853a560f61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037690 Apr 12 00:32:32 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 64/195] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:32 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-ea32a49b-dfa5-47f5-8b14-ea5b13ebc1a3 req-ad1a9fec-b7d2-4135-850c-cc211ba17ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db3a1291-c686-4e29-8499-8d49dd74a7bb", "name": "network-vif-deleted", "tag": "7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:32 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-ea32a49b-dfa5-47f5-8b14-ea5b13ebc1a3 req-ad1a9fec-b7d2-4135-850c-cc211ba17ff0 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:32 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-ea32a49b-dfa5-47f5-8b14-ea5b13ebc1a3 req-ad1a9fec-b7d2-4135-850c-cc211ba17ff0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:32 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-ea32a49b-dfa5-47f5-8b14-ea5b13ebc1a3 req-ad1a9fec-b7d2-4135-850c-cc211ba17ff0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:32 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-ea32a49b-dfa5-47f5-8b14-ea5b13ebc1a3 req-ad1a9fec-b7d2-4135-850c-cc211ba17ff0 service nova] Creating event network-vif-deleted:7c91ba2b-6c3b-41b9-ba82-34a9e5d8f3ed for instance db3a1291-c686-4e29-8499-8d49dd74a7bb on user Apr 12 00:32:32 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-ea32a49b-dfa5-47f5-8b14-ea5b13ebc1a3 req-ad1a9fec-b7d2-4135-850c-cc211ba17ff0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052881 Apr 12 00:32:32 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 67/196] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:32 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:32 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:33 user devstack@n-api.service[72495]: DEBUG nova.objects.instance [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lazy-loading 'services' on Instance uuid f9dc12da-4db1-4305-93ea-2bd63870c097 {{(pid=72495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:32:33 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-884933c0-4294-49fb-8062-e476cbdfa862 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097/os-volume_attachments/e2052f02-80cb-4f9f-b9d6-e4525e872af4" status: 202 len: 0 microversion: 2.49 time: 0.261423 Apr 12 00:32:33 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 66/197] 10.0.0.210 () {64 vars in 1534 bytes} [Wed Apr 12 00:32:32 2023] DELETE /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097/os-volume_attachments/e2052f02-80cb-4f9f-b9d6-e4525e872af4 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:32:35 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:35 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:35 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-797837f9-e52c-41ba-8e5d-a56365dd8e8d tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097/os-interface/27eab0c4-101d-46a5-a472-d7de01ee4f14" status: 202 len: 0 microversion: 2.49 time: 0.083955 Apr 12 00:32:35 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 65/198] 10.0.0.210 () {64 vars in 1507 bytes} [Wed Apr 12 00:32:35 2023] DELETE /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097/os-interface/27eab0c4-101d-46a5-a472-d7de01ee4f14 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:32:35 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-efa4f689-7f2f-4a70-aa05-ec2f436511f8 tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:35 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-efa4f689-7f2f-4a70-aa05-ec2f436511f8 tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-efa4f689-7f2f-4a70-aa05-ec2f436511f8 tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-efa4f689-7f2f-4a70-aa05-ec2f436511f8 tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-efa4f689-7f2f-4a70-aa05-ec2f436511f8 tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-efa4f689-7f2f-4a70-aa05-ec2f436511f8 tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-efa4f689-7f2f-4a70-aa05-ec2f436511f8 tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-efa4f689-7f2f-4a70-aa05-ec2f436511f8 tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:35 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-efa4f689-7f2f-4a70-aa05-ec2f436511f8 tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097/os-instance-actions/req-797837f9-e52c-41ba-8e5d-a56365dd8e8d" status: 200 len: 474 microversion: 2.49 time: 0.202719 Apr 12 00:32:35 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 68/199] 10.0.0.210 () {64 vars in 1537 bytes} [Wed Apr 12 00:32:35 2023] GET /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097/os-instance-actions/req-797837f9-e52c-41ba-8e5d-a56365dd8e8d => generated 474 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:32:36 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-3ed94c21-c47a-4665-896f-26c0cb25757f req-27f392b2-530a-4eef-a90b-a40dbbde761f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9dc12da-4db1-4305-93ea-2bd63870c097", "name": "network-vif-unplugged", "status": "completed", "tag": "27eab0c4-101d-46a5-a472-d7de01ee4f14"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3ed94c21-c47a-4665-896f-26c0cb25757f req-27f392b2-530a-4eef-a90b-a40dbbde761f service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3ed94c21-c47a-4665-896f-26c0cb25757f req-27f392b2-530a-4eef-a90b-a40dbbde761f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3ed94c21-c47a-4665-896f-26c0cb25757f req-27f392b2-530a-4eef-a90b-a40dbbde761f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:36 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-3ed94c21-c47a-4665-896f-26c0cb25757f req-27f392b2-530a-4eef-a90b-a40dbbde761f service nova] Creating event network-vif-unplugged:27eab0c4-101d-46a5-a472-d7de01ee4f14 for instance f9dc12da-4db1-4305-93ea-2bd63870c097 on user Apr 12 00:32:36 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-3ed94c21-c47a-4665-896f-26c0cb25757f req-27f392b2-530a-4eef-a90b-a40dbbde761f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032553 Apr 12 00:32:36 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 67/200] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:36 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-ae75dbd6-21a1-4081-b0f0-861650b2f797 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:36 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-ae75dbd6-21a1-4081-b0f0-861650b2f797 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ae75dbd6-21a1-4081-b0f0-861650b2f797 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ae75dbd6-21a1-4081-b0f0-861650b2f797 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ae75dbd6-21a1-4081-b0f0-861650b2f797 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ae75dbd6-21a1-4081-b0f0-861650b2f797 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ae75dbd6-21a1-4081-b0f0-861650b2f797 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ae75dbd6-21a1-4081-b0f0-861650b2f797 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:36 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9dc12da-4db1-4305-93ea-2bd63870c097", "name": "network-vif-deleted", "tag": "27eab0c4-101d-46a5-a472-d7de01ee4f14"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:36 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:36 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:36 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:36 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-ae75dbd6-21a1-4081-b0f0-861650b2f797 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052658 Apr 12 00:32:36 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 66/201] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:32:36 2023] GET /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:36 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-00066bdf-e272-4579-a3d9-408f22156d4a tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:36 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] Creating event network-vif-deleted:27eab0c4-101d-46a5-a472-d7de01ee4f14 for instance f9dc12da-4db1-4305-93ea-2bd63870c097 on user Apr 12 00:32:36 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-00066bdf-e272-4579-a3d9-408f22156d4a tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:36 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-2ae2ec52-5e80-4f28-ac87-81b39b8f1fc3 req-b94d5c70-9951-4644-b290-c0df92a7f2e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035252 Apr 12 00:32:36 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 69/202] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-00066bdf-e272-4579-a3d9-408f22156d4a tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-00066bdf-e272-4579-a3d9-408f22156d4a tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-00066bdf-e272-4579-a3d9-408f22156d4a tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-00066bdf-e272-4579-a3d9-408f22156d4a tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-00066bdf-e272-4579-a3d9-408f22156d4a tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-00066bdf-e272-4579-a3d9-408f22156d4a tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:36 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-00066bdf-e272-4579-a3d9-408f22156d4a tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055704 Apr 12 00:32:36 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 68/203] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:32:36 2023] GET /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:36 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "65678a70-1c74-42ac-9334-dd959c1ea80f"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:36 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:36 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-ffdd963a-d1c5-4389-9dac-856b23027f26 tempest-TestVolumeSwap-1675144960 tempest-TestVolumeSwap-1675144960-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47/os-volume_attachments/d3d5ecec-19dc-4989-a561-09ad5028728b" status: 202 len: 0 microversion: 2.1 time: 0.337857 Apr 12 00:32:36 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 67/204] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 00:32:36 2023] PUT /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47/os-volume_attachments/d3d5ecec-19dc-4989-a561-09ad5028728b => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:32:38 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-fe477c03-2801-4dbb-a5e9-f476cdaf3a03 req-5467998f-ebd5-43c1-9bf4-5bbf8916f1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9dc12da-4db1-4305-93ea-2bd63870c097", "name": "network-vif-plugged", "status": "completed", "tag": "27eab0c4-101d-46a5-a472-d7de01ee4f14"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-fe477c03-2801-4dbb-a5e9-f476cdaf3a03 req-5467998f-ebd5-43c1-9bf4-5bbf8916f1c4 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-fe477c03-2801-4dbb-a5e9-f476cdaf3a03 req-5467998f-ebd5-43c1-9bf4-5bbf8916f1c4 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-fe477c03-2801-4dbb-a5e9-f476cdaf3a03 req-5467998f-ebd5-43c1-9bf4-5bbf8916f1c4 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:38 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-fe477c03-2801-4dbb-a5e9-f476cdaf3a03 req-5467998f-ebd5-43c1-9bf4-5bbf8916f1c4 service nova] Creating event network-vif-plugged:27eab0c4-101d-46a5-a472-d7de01ee4f14 for instance f9dc12da-4db1-4305-93ea-2bd63870c097 on user Apr 12 00:32:38 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-fe477c03-2801-4dbb-a5e9-f476cdaf3a03 req-5467998f-ebd5-43c1-9bf4-5bbf8916f1c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029706 Apr 12 00:32:38 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 70/205] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:40 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-cbf1f518-9309-430c-8bee-227fed1c7ea8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:40 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-cbf1f518-9309-430c-8bee-227fed1c7ea8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:40 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:32:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cbf1f518-9309-430c-8bee-227fed1c7ea8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cbf1f518-9309-430c-8bee-227fed1c7ea8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cbf1f518-9309-430c-8bee-227fed1c7ea8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cbf1f518-9309-430c-8bee-227fed1c7ea8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cbf1f518-9309-430c-8bee-227fed1c7ea8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cbf1f518-9309-430c-8bee-227fed1c7ea8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:40 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:32:40 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-cbf1f518-9309-430c-8bee-227fed1c7ea8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:40 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-cbf1f518-9309-430c-8bee-227fed1c7ea8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 200 len: 1658 microversion: 2.1 time: 0.174892 Apr 12 00:32:40 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 69/206] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:32:40 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 1658 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:40 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-30bc04d6-12bc-4bea-97ce-4e30e15865a6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:40 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-30bc04d6-12bc-4bea-97ce-4e30e15865a6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:40 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-30bc04d6-12bc-4bea-97ce-4e30e15865a6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:40 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-30bc04d6-12bc-4bea-97ce-4e30e15865a6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:40 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-30bc04d6-12bc-4bea-97ce-4e30e15865a6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:40 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-30bc04d6-12bc-4bea-97ce-4e30e15865a6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:40 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-30bc04d6-12bc-4bea-97ce-4e30e15865a6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:40 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-30bc04d6-12bc-4bea-97ce-4e30e15865a6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:41 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-30bc04d6-12bc-4bea-97ce-4e30e15865a6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:41 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-30bc04d6-12bc-4bea-97ce-4e30e15865a6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 200 len: 1658 microversion: 2.1 time: 0.155690 Apr 12 00:32:41 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 68/207] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:32:40 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 1658 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:42 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-64b2d6eb-578f-424f-96cf-02c0c8e80b29 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:42 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-64b2d6eb-578f-424f-96cf-02c0c8e80b29 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-64b2d6eb-578f-424f-96cf-02c0c8e80b29 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-64b2d6eb-578f-424f-96cf-02c0c8e80b29 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-64b2d6eb-578f-424f-96cf-02c0c8e80b29 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-64b2d6eb-578f-424f-96cf-02c0c8e80b29 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-64b2d6eb-578f-424f-96cf-02c0c8e80b29 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-64b2d6eb-578f-424f-96cf-02c0c8e80b29 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:42 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-64b2d6eb-578f-424f-96cf-02c0c8e80b29 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3b52368-86be-4211-a37b-522ed3991a00/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.129725 Apr 12 00:32:42 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 71/208] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 00:32:41 2023] GET /compute/v2.1/servers/e3b52368-86be-4211-a37b-522ed3991a00/os-interface => generated 1829 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:32:42 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-a5a40941-1c59-4c05-89a4-552f4d0e9b31 req-4731fb63-03ed-4e76-b6dc-f9bda7f310ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "tag": "ad31f866-7d58-49a8-9e24-17ec4ad04a48"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:42 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a5a40941-1c59-4c05-89a4-552f4d0e9b31 req-4731fb63-03ed-4e76-b6dc-f9bda7f310ef service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:42 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a5a40941-1c59-4c05-89a4-552f4d0e9b31 req-4731fb63-03ed-4e76-b6dc-f9bda7f310ef service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:42 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a5a40941-1c59-4c05-89a4-552f4d0e9b31 req-4731fb63-03ed-4e76-b6dc-f9bda7f310ef service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:42 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-a5a40941-1c59-4c05-89a4-552f4d0e9b31 req-4731fb63-03ed-4e76-b6dc-f9bda7f310ef service nova] Creating event network-changed:ad31f866-7d58-49a8-9e24-17ec4ad04a48 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:32:42 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-a5a40941-1c59-4c05-89a4-552f4d0e9b31 req-4731fb63-03ed-4e76-b6dc-f9bda7f310ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036052 Apr 12 00:32:42 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 70/209] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:42 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-15929120-77bf-4ec4-9a83-02e38f6090c8 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:42 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-15929120-77bf-4ec4-9a83-02e38f6090c8 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-15929120-77bf-4ec4-9a83-02e38f6090c8 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-15929120-77bf-4ec4-9a83-02e38f6090c8 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-15929120-77bf-4ec4-9a83-02e38f6090c8 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-15929120-77bf-4ec4-9a83-02e38f6090c8 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-15929120-77bf-4ec4-9a83-02e38f6090c8 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-15929120-77bf-4ec4-9a83-02e38f6090c8 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:43 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-15929120-77bf-4ec4-9a83-02e38f6090c8 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846fa2a73bbb4036ad3fb19afc811131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45d99a301794a748dadf4c96860835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:43 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-15929120-77bf-4ec4-9a83-02e38f6090c8 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '846fa2a73bbb4036ad3fb19afc811131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45d99a301794a748dadf4c96860835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:43 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-15929120-77bf-4ec4-9a83-02e38f6090c8 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '846fa2a73bbb4036ad3fb19afc811131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45d99a301794a748dadf4c96860835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:43 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-15929120-77bf-4ec4-9a83-02e38f6090c8 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3b52368-86be-4211-a37b-522ed3991a00" status: 200 len: 2828 microversion: 2.42 time: 0.220973 Apr 12 00:32:43 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 69/210] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:32:42 2023] GET /compute/v2.1/servers/e3b52368-86be-4211-a37b-522ed3991a00 => generated 2828 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:32:43 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-5762d092-d68d-4266-86fd-884b1e701ae3 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:43 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-5762d092-d68d-4266-86fd-884b1e701ae3 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:43 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=29 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:32:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-5762d092-d68d-4266-86fd-884b1e701ae3 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-5762d092-d68d-4266-86fd-884b1e701ae3 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-5762d092-d68d-4266-86fd-884b1e701ae3 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-5762d092-d68d-4266-86fd-884b1e701ae3 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-5762d092-d68d-4266-86fd-884b1e701ae3 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-5762d092-d68d-4266-86fd-884b1e701ae3 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:43 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:32:43 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-5762d092-d68d-4266-86fd-884b1e701ae3 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3b52368-86be-4211-a37b-522ed3991a00/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.260710 Apr 12 00:32:43 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 72/211] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 00:32:43 2023] GET /compute/v2.1/servers/e3b52368-86be-4211-a37b-522ed3991a00/os-interface => generated 1829 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:32:44 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-d4bd9d1a-5a73-4beb-80a8-89bc318ea408 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:44 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-d4bd9d1a-5a73-4beb-80a8-89bc318ea408 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:44 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d4bd9d1a-5a73-4beb-80a8-89bc318ea408 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:44 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d4bd9d1a-5a73-4beb-80a8-89bc318ea408 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:44 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d4bd9d1a-5a73-4beb-80a8-89bc318ea408 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:44 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d4bd9d1a-5a73-4beb-80a8-89bc318ea408 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:44 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d4bd9d1a-5a73-4beb-80a8-89bc318ea408 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:44 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d4bd9d1a-5a73-4beb-80a8-89bc318ea408 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:44 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-d4bd9d1a-5a73-4beb-80a8-89bc318ea408 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f784806a-987f-4861-a23a-dbf961c8b6c1/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.184736 Apr 12 00:32:44 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 71/212] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 00:32:44 2023] GET /compute/v2.1/servers/f784806a-987f-4861-a23a-dbf961c8b6c1/os-interface => generated 1828 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:32:44 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:44 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:44 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=29 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:32:44 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:44 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:44 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:44 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:44 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:44 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:44 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:32:44 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Going to try to terminate instance {{(pid=72494) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:32:44 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-63d9caaf-68c4-46ab-9c37-c06f5c69e68a tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e3b52368-86be-4211-a37b-522ed3991a00" status: 204 len: 0 microversion: 2.42 time: 0.217593 Apr 12 00:32:44 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 70/213] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 00:32:44 2023] DELETE /compute/v2.1/servers/e3b52368-86be-4211-a37b-522ed3991a00 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 00:32:44 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-f26dfb75-eee7-4af1-a9f7-591468fdd7ed tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:44 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-f26dfb75-eee7-4af1-a9f7-591468fdd7ed tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f26dfb75-eee7-4af1-a9f7-591468fdd7ed tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f26dfb75-eee7-4af1-a9f7-591468fdd7ed tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f26dfb75-eee7-4af1-a9f7-591468fdd7ed tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f26dfb75-eee7-4af1-a9f7-591468fdd7ed tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f26dfb75-eee7-4af1-a9f7-591468fdd7ed tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f26dfb75-eee7-4af1-a9f7-591468fdd7ed tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:45 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-f26dfb75-eee7-4af1-a9f7-591468fdd7ed tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846fa2a73bbb4036ad3fb19afc811131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45d99a301794a748dadf4c96860835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:45 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-f26dfb75-eee7-4af1-a9f7-591468fdd7ed tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '846fa2a73bbb4036ad3fb19afc811131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45d99a301794a748dadf4c96860835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:45 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-f26dfb75-eee7-4af1-a9f7-591468fdd7ed tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '846fa2a73bbb4036ad3fb19afc811131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c45d99a301794a748dadf4c96860835c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:45 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-f26dfb75-eee7-4af1-a9f7-591468fdd7ed tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3b52368-86be-4211-a37b-522ed3991a00" status: 200 len: 2952 microversion: 2.42 time: 0.298615 Apr 12 00:32:45 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 73/214] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:32:44 2023] GET /compute/v2.1/servers/e3b52368-86be-4211-a37b-522ed3991a00 => generated 2952 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:32:45 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-b05155c0-63ac-44af-b1ba-2815421ae779 req-4662ee47-1ebf-47be-925e-831ee73facef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-unplugged", "status": "completed", "tag": "ad31f866-7d58-49a8-9e24-17ec4ad04a48"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-b05155c0-63ac-44af-b1ba-2815421ae779 req-4662ee47-1ebf-47be-925e-831ee73facef service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-b05155c0-63ac-44af-b1ba-2815421ae779 req-4662ee47-1ebf-47be-925e-831ee73facef service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-b05155c0-63ac-44af-b1ba-2815421ae779 req-4662ee47-1ebf-47be-925e-831ee73facef service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:45 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-b05155c0-63ac-44af-b1ba-2815421ae779 req-4662ee47-1ebf-47be-925e-831ee73facef service nova] Creating event network-vif-unplugged:ad31f866-7d58-49a8-9e24-17ec4ad04a48 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:32:45 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-b05155c0-63ac-44af-b1ba-2815421ae779 req-4662ee47-1ebf-47be-925e-831ee73facef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075110 Apr 12 00:32:45 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 72/215] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:45 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-863d59c7-9d5c-417d-808c-9c80c7c7a4be req-7476ab67-abe6-4e2b-a781-521836bd69a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "tag": "09b82fec-ca71-4934-ac24-073ca9080c9c"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:45 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-863d59c7-9d5c-417d-808c-9c80c7c7a4be req-7476ab67-abe6-4e2b-a781-521836bd69a9 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:45 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-863d59c7-9d5c-417d-808c-9c80c7c7a4be req-7476ab67-abe6-4e2b-a781-521836bd69a9 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:45 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-863d59c7-9d5c-417d-808c-9c80c7c7a4be req-7476ab67-abe6-4e2b-a781-521836bd69a9 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:45 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-863d59c7-9d5c-417d-808c-9c80c7c7a4be req-7476ab67-abe6-4e2b-a781-521836bd69a9 service nova] Creating event network-changed:09b82fec-ca71-4934-ac24-073ca9080c9c for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:32:45 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-863d59c7-9d5c-417d-808c-9c80c7c7a4be req-7476ab67-abe6-4e2b-a781-521836bd69a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053056 Apr 12 00:32:45 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 71/216] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:45 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-bf843f82-c639-4009-960e-7bdf26e3752d req-d5995345-84dd-48bc-b538-6ec1a1c6eb51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-unplugged", "status": "completed", "tag": "b9c15342-4557-47ce-a9ed-4c378fe66186"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:45 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-bf843f82-c639-4009-960e-7bdf26e3752d req-d5995345-84dd-48bc-b538-6ec1a1c6eb51 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:45 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-bf843f82-c639-4009-960e-7bdf26e3752d req-d5995345-84dd-48bc-b538-6ec1a1c6eb51 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:45 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-bf843f82-c639-4009-960e-7bdf26e3752d req-d5995345-84dd-48bc-b538-6ec1a1c6eb51 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:45 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-bf843f82-c639-4009-960e-7bdf26e3752d req-d5995345-84dd-48bc-b538-6ec1a1c6eb51 service nova] Creating event network-vif-unplugged:b9c15342-4557-47ce-a9ed-4c378fe66186 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:32:45 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-7277a7d9-3b73-48a8-bb4b-05c279c715ee tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:45 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-7277a7d9-3b73-48a8-bb4b-05c279c715ee tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:45 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-bf843f82-c639-4009-960e-7bdf26e3752d req-d5995345-84dd-48bc-b538-6ec1a1c6eb51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097114 Apr 12 00:32:45 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 74/217] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:32:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7277a7d9-3b73-48a8-bb4b-05c279c715ee tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7277a7d9-3b73-48a8-bb4b-05c279c715ee tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7277a7d9-3b73-48a8-bb4b-05c279c715ee tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7277a7d9-3b73-48a8-bb4b-05c279c715ee tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7277a7d9-3b73-48a8-bb4b-05c279c715ee tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7277a7d9-3b73-48a8-bb4b-05c279c715ee tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:46 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-7277a7d9-3b73-48a8-bb4b-05c279c715ee tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6b3a1f732c47e1aaa08b26056695d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b2a25677e14a23ae7b81e2e56c008a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:46 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-7277a7d9-3b73-48a8-bb4b-05c279c715ee tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df6b3a1f732c47e1aaa08b26056695d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b2a25677e14a23ae7b81e2e56c008a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:46 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-7277a7d9-3b73-48a8-bb4b-05c279c715ee tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df6b3a1f732c47e1aaa08b26056695d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b2a25677e14a23ae7b81e2e56c008a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:46 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-7277a7d9-3b73-48a8-bb4b-05c279c715ee tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f784806a-987f-4861-a23a-dbf961c8b6c1" status: 200 len: 2823 microversion: 2.32 time: 0.481292 Apr 12 00:32:46 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 73/218] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:32:45 2023] GET /compute/v2.1/servers/f784806a-987f-4861-a23a-dbf961c8b6c1 => generated 2823 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:32:46 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-e1bd9fad-e9ce-4e1c-bed4-43f001b24a6b tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:46 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-e1bd9fad-e9ce-4e1c-bed4-43f001b24a6b tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:46 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e1bd9fad-e9ce-4e1c-bed4-43f001b24a6b tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:46 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e1bd9fad-e9ce-4e1c-bed4-43f001b24a6b tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:46 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e1bd9fad-e9ce-4e1c-bed4-43f001b24a6b tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:46 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e1bd9fad-e9ce-4e1c-bed4-43f001b24a6b tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:46 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e1bd9fad-e9ce-4e1c-bed4-43f001b24a6b tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:46 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e1bd9fad-e9ce-4e1c-bed4-43f001b24a6b tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:46 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-e1bd9fad-e9ce-4e1c-bed4-43f001b24a6b tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f784806a-987f-4861-a23a-dbf961c8b6c1/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.219970 Apr 12 00:32:46 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 72/219] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 00:32:46 2023] GET /compute/v2.1/servers/f784806a-987f-4861-a23a-dbf961c8b6c1/os-interface => generated 1828 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:32:47 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-plugged", "status": "completed", "tag": "ad31f866-7d58-49a8-9e24-17ec4ad04a48"}, {"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-unplugged", "status": "completed", "tag": "6903c204-8c47-4dbf-991d-28e91739df40"}, {"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-plugged", "status": "completed", "tag": "6903c204-8c47-4dbf-991d-28e91739df40"}, {"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-unplugged", "status": "completed", "tag": "34faa1f7-7c0e-4272-a3b6-092979dd46b8"}, {"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-plugged", "status": "completed", "tag": "34faa1f7-7c0e-4272-a3b6-092979dd46b8"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:47 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] Creating event network-vif-plugged:ad31f866-7d58-49a8-9e24-17ec4ad04a48 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:32:47 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] Creating event network-vif-unplugged:6903c204-8c47-4dbf-991d-28e91739df40 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:32:47 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] Creating event network-vif-plugged:6903c204-8c47-4dbf-991d-28e91739df40 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:32:47 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] Creating event network-vif-unplugged:34faa1f7-7c0e-4272-a3b6-092979dd46b8 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:32:47 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] Creating event network-vif-plugged:34faa1f7-7c0e-4272-a3b6-092979dd46b8 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:32:47 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-0f4d97f5-2f21-4b34-accd-6a18cf9c6ad4 req-75a92d49-2f66-4057-bdbe-985eb2ba84ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.033192 Apr 12 00:32:47 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 75/220] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:47 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:47 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-unplugged", "status": "completed", "tag": "02d77b15-fb16-44e3-9c20-d319e7302449"}, {"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-plugged", "status": "completed", "tag": "02d77b15-fb16-44e3-9c20-d319e7302449"}, {"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-unplugged", "status": "completed", "tag": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6"}, {"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-plugged", "status": "completed", "tag": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:47 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] Creating event network-vif-unplugged:02d77b15-fb16-44e3-9c20-d319e7302449 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:32:47 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] Creating event network-vif-plugged:02d77b15-fb16-44e3-9c20-d319e7302449 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:32:47 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] Creating event network-vif-unplugged:4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:32:47 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] Creating event network-vif-plugged:4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:32:47 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-4f79b6a9-c1ef-4e6e-b192-d8aa0bc7daa0 req-9d888366-db53-4a24-b76f-1d9a7146c649 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.034337 Apr 12 00:32:47 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 74/221] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:47 2023] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:47 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:47 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:47 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Going to try to terminate instance {{(pid=72494) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:32:47 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-fcb235c6-8fd2-4757-b266-1cc5f01194e5 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f784806a-987f-4861-a23a-dbf961c8b6c1" status: 204 len: 0 microversion: 2.32 time: 0.127713 Apr 12 00:32:47 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 73/222] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 00:32:47 2023] DELETE /compute/v2.1/servers/f784806a-987f-4861-a23a-dbf961c8b6c1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 00:32:47 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-518183a3-0624-4a91-b083-73880a4fd8e4 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:47 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-518183a3-0624-4a91-b083-73880a4fd8e4 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:47 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-plugged", "status": "completed", "tag": "b9c15342-4557-47ce-a9ed-4c378fe66186"}, {"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-unplugged", "status": "completed", "tag": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46"}, {"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-plugged", "status": "completed", "tag": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-518183a3-0624-4a91-b083-73880a4fd8e4 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-518183a3-0624-4a91-b083-73880a4fd8e4 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-518183a3-0624-4a91-b083-73880a4fd8e4 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-518183a3-0624-4a91-b083-73880a4fd8e4 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-518183a3-0624-4a91-b083-73880a4fd8e4 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-518183a3-0624-4a91-b083-73880a4fd8e4 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:47 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] Creating event network-vif-plugged:b9c15342-4557-47ce-a9ed-4c378fe66186 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:32:47 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] Creating event network-vif-unplugged:b09d545e-e05d-42e0-b1d4-46fe7d8a6e46 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:32:47 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] Creating event network-vif-plugged:b09d545e-e05d-42e0-b1d4-46fe7d8a6e46 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:32:47 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-2b2b9fcc-6689-4fd7-a3c1-4655ae720e56 req-92a1c4f0-c4ba-4abf-b220-47e19ef83f15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.031244 Apr 12 00:32:47 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 75/223] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:47 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:48 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-518183a3-0624-4a91-b083-73880a4fd8e4 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6b3a1f732c47e1aaa08b26056695d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b2a25677e14a23ae7b81e2e56c008a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:48 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-518183a3-0624-4a91-b083-73880a4fd8e4 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df6b3a1f732c47e1aaa08b26056695d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b2a25677e14a23ae7b81e2e56c008a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:48 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-518183a3-0624-4a91-b083-73880a4fd8e4 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df6b3a1f732c47e1aaa08b26056695d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6b2a25677e14a23ae7b81e2e56c008a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:48 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-518183a3-0624-4a91-b083-73880a4fd8e4 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f784806a-987f-4861-a23a-dbf961c8b6c1" status: 200 len: 2947 microversion: 2.32 time: 0.235581 Apr 12 00:32:48 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 76/224] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:32:47 2023] GET /compute/v2.1/servers/f784806a-987f-4861-a23a-dbf961c8b6c1 => generated 2947 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:32:48 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-23b99d45-ab8f-4f14-9e0f-f631e94c372d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:48 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-23b99d45-ab8f-4f14-9e0f-f631e94c372d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:48 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-23b99d45-ab8f-4f14-9e0f-f631e94c372d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:48 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-23b99d45-ab8f-4f14-9e0f-f631e94c372d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:48 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-23b99d45-ab8f-4f14-9e0f-f631e94c372d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:48 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-23b99d45-ab8f-4f14-9e0f-f631e94c372d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:48 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-23b99d45-ab8f-4f14-9e0f-f631e94c372d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:48 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-23b99d45-ab8f-4f14-9e0f-f631e94c372d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:48 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-23b99d45-ab8f-4f14-9e0f-f631e94c372d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:48 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-23b99d45-ab8f-4f14-9e0f-f631e94c372d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f1f85bf-03e5-493e-b187-955998b020ee" status: 200 len: 1378 microversion: 2.1 time: 0.243667 Apr 12 00:32:48 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 74/225] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:32:48 2023] GET /compute/v2.1/servers/7f1f85bf-03e5-493e-b187-955998b020ee => generated 1378 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:48 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-ec49d065-a40b-41c9-a7ac-d5d918d23931 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:48 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-ec49d065-a40b-41c9-a7ac-d5d918d23931 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:48 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ec49d065-a40b-41c9-a7ac-d5d918d23931 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:48 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ec49d065-a40b-41c9-a7ac-d5d918d23931 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:48 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ec49d065-a40b-41c9-a7ac-d5d918d23931 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:48 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ec49d065-a40b-41c9-a7ac-d5d918d23931 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:48 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ec49d065-a40b-41c9-a7ac-d5d918d23931 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:48 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ec49d065-a40b-41c9-a7ac-d5d918d23931 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:48 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-4c0c60ea-7bc8-4e52-9e01-0adc43ca9d0e tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:48 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-4c0c60ea-7bc8-4e52-9e01-0adc43ca9d0e tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4c0c60ea-7bc8-4e52-9e01-0adc43ca9d0e tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4c0c60ea-7bc8-4e52-9e01-0adc43ca9d0e tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4c0c60ea-7bc8-4e52-9e01-0adc43ca9d0e tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4c0c60ea-7bc8-4e52-9e01-0adc43ca9d0e tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4c0c60ea-7bc8-4e52-9e01-0adc43ca9d0e tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4c0c60ea-7bc8-4e52-9e01-0adc43ca9d0e tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:49 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-4c0c60ea-7bc8-4e52-9e01-0adc43ca9d0e tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057572 Apr 12 00:32:49 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 77/226] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:32:48 2023] GET /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:49 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-4ecc25b2-615c-4b15-a270-be179061c923 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:49 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-ec49d065-a40b-41c9-a7ac-d5d918d23931 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:49 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-4ecc25b2-615c-4b15-a270-be179061c923 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4ecc25b2-615c-4b15-a270-be179061c923 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4ecc25b2-615c-4b15-a270-be179061c923 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4ecc25b2-615c-4b15-a270-be179061c923 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4ecc25b2-615c-4b15-a270-be179061c923 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:49 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-ec49d065-a40b-41c9-a7ac-d5d918d23931 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f1f85bf-03e5-493e-b187-955998b020ee" status: 200 len: 1378 microversion: 2.1 time: 0.277221 Apr 12 00:32:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4ecc25b2-615c-4b15-a270-be179061c923 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:49 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 76/227] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:32:48 2023] GET /compute/v2.1/servers/7f1f85bf-03e5-493e-b187-955998b020ee => generated 1378 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4ecc25b2-615c-4b15-a270-be179061c923 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:49 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-4ecc25b2-615c-4b15-a270-be179061c923 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043819 Apr 12 00:32:49 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 75/228] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:32:49 2023] GET /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:49 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:49 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Going to try to terminate instance {{(pid=72496) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:32:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:49 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-565b99e2-73de-445d-b046-312b5e3304c8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7f1f85bf-03e5-493e-b187-955998b020ee" status: 204 len: 0 microversion: 2.1 time: 0.150946 Apr 12 00:32:49 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 78/229] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:32:49 2023] DELETE /compute/v2.1/servers/7f1f85bf-03e5-493e-b187-955998b020ee => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:32:49 user devstack@n-api.service[72495]: DEBUG nova.objects.instance [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lazy-loading 'services' on Instance uuid 5be536dd-61f5-4a17-a734-029b25739a47 {{(pid=72495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:32:49 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-31b2db73-8a6b-495e-8607-81d9fb545717 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:49 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-31b2db73-8a6b-495e-8607-81d9fb545717 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-31b2db73-8a6b-495e-8607-81d9fb545717 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-31b2db73-8a6b-495e-8607-81d9fb545717 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-31b2db73-8a6b-495e-8607-81d9fb545717 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-31b2db73-8a6b-495e-8607-81d9fb545717 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-31b2db73-8a6b-495e-8607-81d9fb545717 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-31b2db73-8a6b-495e-8607-81d9fb545717 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:49 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-21fcf125-8fc4-44ed-af52-7c6925801492 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47/os-volume_attachments/65678a70-1c74-42ac-9334-dd959c1ea80f" status: 202 len: 0 microversion: 2.1 time: 0.207920 Apr 12 00:32:49 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 77/230] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 00:32:49 2023] DELETE /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47/os-volume_attachments/65678a70-1c74-42ac-9334-dd959c1ea80f => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-fadf81ca-e9e9-4c5b-bf91-8424c9bf5b55 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-fadf81ca-e9e9-4c5b-bf91-8424c9bf5b55 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fadf81ca-e9e9-4c5b-bf91-8424c9bf5b55 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fadf81ca-e9e9-4c5b-bf91-8424c9bf5b55 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fadf81ca-e9e9-4c5b-bf91-8424c9bf5b55 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fadf81ca-e9e9-4c5b-bf91-8424c9bf5b55 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fadf81ca-e9e9-4c5b-bf91-8424c9bf5b55 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fadf81ca-e9e9-4c5b-bf91-8424c9bf5b55 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:49 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-fadf81ca-e9e9-4c5b-bf91-8424c9bf5b55 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098158 Apr 12 00:32:49 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 79/231] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:32:49 2023] GET /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:49 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-unplugged", "status": "completed", "tag": "09b82fec-ca71-4934-ac24-073ca9080c9c"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "09b82fec-ca71-4934-ac24-073ca9080c9c"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-unplugged", "status": "completed", "tag": "0b6ea381-2a40-4f39-a8a5-88a31565ea17"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "0b6ea381-2a40-4f39-a8a5-88a31565ea17"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-unplugged", "status": "completed", "tag": "bb8ab354-dbbc-4141-9499-5689ae95fb2f"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "bb8ab354-dbbc-4141-9499-5689ae95fb2f"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:49 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-31b2db73-8a6b-495e-8607-81d9fb545717 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:49 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-31b2db73-8a6b-495e-8607-81d9fb545717 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f1f85bf-03e5-493e-b187-955998b020ee" status: 200 len: 1384 microversion: 2.1 time: 0.326803 Apr 12 00:32:49 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 76/232] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:32:49 2023] GET /compute/v2.1/servers/7f1f85bf-03e5-493e-b187-955998b020ee => generated 1384 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:49 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Creating event network-vif-unplugged:09b82fec-ca71-4934-ac24-073ca9080c9c for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:32:49 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Creating event network-vif-plugged:09b82fec-ca71-4934-ac24-073ca9080c9c for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:32:49 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Creating event network-vif-unplugged:0b6ea381-2a40-4f39-a8a5-88a31565ea17 for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:32:49 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Creating event network-vif-plugged:0b6ea381-2a40-4f39-a8a5-88a31565ea17 for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:32:49 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Creating event network-vif-unplugged:bb8ab354-dbbc-4141-9499-5689ae95fb2f for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:32:49 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] Creating event network-vif-plugged:bb8ab354-dbbc-4141-9499-5689ae95fb2f for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:32:49 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-7e53ec45-9b95-435a-af99-348440f3047f req-bd45990e-6cf2-4b19-b935-79739d9fc2ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1044 microversion: 2.1 time: 0.071350 Apr 12 00:32:49 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 78/233] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:49 2023] POST /compute/v2.1/os-server-external-events => generated 1044 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-unplugged", "status": "completed", "tag": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "8d5703b7-ffc6-4337-9cbe-98328e04c0eb"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-unplugged", "status": "completed", "tag": "f9be977e-033f-44cb-adda-1590a13ccbdb"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "f9be977e-033f-44cb-adda-1590a13ccbdb"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:49 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] Creating event network-vif-unplugged:8d5703b7-ffc6-4337-9cbe-98328e04c0eb for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:32:49 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] Creating event network-vif-plugged:8d5703b7-ffc6-4337-9cbe-98328e04c0eb for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:32:49 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] Creating event network-vif-unplugged:f9be977e-033f-44cb-adda-1590a13ccbdb for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:32:49 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] Creating event network-vif-plugged:f9be977e-033f-44cb-adda-1590a13ccbdb for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:32:50 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-fd8b773f-bc6d-4117-ad0b-c08807262ea1 req-a523192c-8d32-4581-bed2-25f5bc68ecdc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.069266 Apr 12 00:32:50 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 80/234] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:49 2023] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:51 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-unplugged", "status": "completed", "tag": "f528d725-8cc8-49c2-8e45-56340893e4c7"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "f528d725-8cc8-49c2-8e45-56340893e4c7"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-unplugged", "status": "completed", "tag": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-plugged", "status": "completed", "tag": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b"}, {"server_uuid": "7f1f85bf-03e5-493e-b187-955998b020ee", "name": "network-vif-unplugged", "status": "completed", "tag": "b987249f-523f-4356-bdc9-82518d86209b"}, {"server_uuid": "7f1f85bf-03e5-493e-b187-955998b020ee", "name": "network-vif-plugged", "status": "completed", "tag": "b987249f-523f-4356-bdc9-82518d86209b"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:51 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Creating event network-vif-unplugged:f528d725-8cc8-49c2-8e45-56340893e4c7 for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:32:51 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Creating event network-vif-plugged:f528d725-8cc8-49c2-8e45-56340893e4c7 for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:32:51 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Creating event network-vif-unplugged:9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:32:51 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Creating event network-vif-plugged:9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:32:51 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Creating event network-vif-unplugged:b987249f-523f-4356-bdc9-82518d86209b for instance 7f1f85bf-03e5-493e-b187-955998b020ee on user Apr 12 00:32:51 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] Creating event network-vif-plugged:b987249f-523f-4356-bdc9-82518d86209b for instance 7f1f85bf-03e5-493e-b187-955998b020ee on user Apr 12 00:32:51 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-d713a724-b76a-4c5b-9608-f9c1e511607e req-23dc24e2-fe31-492d-b660-59bc774d27b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1044 microversion: 2.1 time: 0.040266 Apr 12 00:32:51 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 77/235] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:51 2023] POST /compute/v2.1/os-server-external-events => generated 1044 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:53 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-866b21d3-b501-4b82-8652-97a281393c87 req-457ef11f-59f2-4da9-8ab0-b9e0fcf14621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f1f85bf-03e5-493e-b187-955998b020ee", "name": "network-vif-deleted", "tag": "b987249f-523f-4356-bdc9-82518d86209b"}, {"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-deleted", "tag": "b09d545e-e05d-42e0-b1d4-46fe7d8a6e46"}, {"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-deleted", "tag": "b9c15342-4557-47ce-a9ed-4c378fe66186"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:53 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-866b21d3-b501-4b82-8652-97a281393c87 req-457ef11f-59f2-4da9-8ab0-b9e0fcf14621 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:53 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-866b21d3-b501-4b82-8652-97a281393c87 req-457ef11f-59f2-4da9-8ab0-b9e0fcf14621 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:53 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-866b21d3-b501-4b82-8652-97a281393c87 req-457ef11f-59f2-4da9-8ab0-b9e0fcf14621 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:53 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-866b21d3-b501-4b82-8652-97a281393c87 req-457ef11f-59f2-4da9-8ab0-b9e0fcf14621 service nova] Creating event network-vif-deleted:b987249f-523f-4356-bdc9-82518d86209b for instance 7f1f85bf-03e5-493e-b187-955998b020ee on user Apr 12 00:32:53 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-866b21d3-b501-4b82-8652-97a281393c87 req-457ef11f-59f2-4da9-8ab0-b9e0fcf14621 service nova] Creating event network-vif-deleted:b09d545e-e05d-42e0-b1d4-46fe7d8a6e46 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:32:53 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-866b21d3-b501-4b82-8652-97a281393c87 req-457ef11f-59f2-4da9-8ab0-b9e0fcf14621 service nova] Creating event network-vif-deleted:b9c15342-4557-47ce-a9ed-4c378fe66186 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:32:53 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-866b21d3-b501-4b82-8652-97a281393c87 req-457ef11f-59f2-4da9-8ab0-b9e0fcf14621 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.039517 Apr 12 00:32:53 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 79/236] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:53 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:54 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-9df47fb7-4417-4d92-9907-49f23e2ecc9b tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:32:54 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-9df47fb7-4417-4d92-9907-49f23e2ecc9b tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:54 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9df47fb7-4417-4d92-9907-49f23e2ecc9b tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:54 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9df47fb7-4417-4d92-9907-49f23e2ecc9b tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:54 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9df47fb7-4417-4d92-9907-49f23e2ecc9b tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:54 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9df47fb7-4417-4d92-9907-49f23e2ecc9b tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:54 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9df47fb7-4417-4d92-9907-49f23e2ecc9b tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:54 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9df47fb7-4417-4d92-9907-49f23e2ecc9b tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:54 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-9df47fb7-4417-4d92-9907-49f23e2ecc9b tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e843a45549943cb88b1b3123a2fbe8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0ea21a2d4d400cba79444c68b58aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:32:54 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-9df47fb7-4417-4d92-9907-49f23e2ecc9b tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749" status: 200 len: 1538 microversion: 2.1 time: 0.177698 Apr 12 00:32:54 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 81/237] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:32:54 2023] GET /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749 => generated 1538 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:32:55 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-a4618b84-ac3b-44fe-b29c-541f4f83178e req-3ac04cae-682d-4f24-b1ea-ab3a51c74d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-deleted", "tag": "ad31f866-7d58-49a8-9e24-17ec4ad04a48"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:55 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-a4618b84-ac3b-44fe-b29c-541f4f83178e req-3ac04cae-682d-4f24-b1ea-ab3a51c74d58 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:55 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-a4618b84-ac3b-44fe-b29c-541f4f83178e req-3ac04cae-682d-4f24-b1ea-ab3a51c74d58 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:55 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-a4618b84-ac3b-44fe-b29c-541f4f83178e req-3ac04cae-682d-4f24-b1ea-ab3a51c74d58 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:55 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-a4618b84-ac3b-44fe-b29c-541f4f83178e req-3ac04cae-682d-4f24-b1ea-ab3a51c74d58 service nova] Creating event network-vif-deleted:ad31f866-7d58-49a8-9e24-17ec4ad04a48 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:32:55 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-a4618b84-ac3b-44fe-b29c-541f4f83178e req-3ac04cae-682d-4f24-b1ea-ab3a51c74d58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029980 Apr 12 00:32:55 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 78/238] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:56 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-03197f66-2fa7-42b8-b1fa-aacd52722ebf req-e40b8b34-c589-4a34-b70c-0dd58df41093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25bc2e7-3399-47be-b78d-990acbb51749", "tag": "7f434880-804b-43da-b1ab-5d5e05b5bee1"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:56 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-03197f66-2fa7-42b8-b1fa-aacd52722ebf req-e40b8b34-c589-4a34-b70c-0dd58df41093 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:56 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-03197f66-2fa7-42b8-b1fa-aacd52722ebf req-e40b8b34-c589-4a34-b70c-0dd58df41093 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:56 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-03197f66-2fa7-42b8-b1fa-aacd52722ebf req-e40b8b34-c589-4a34-b70c-0dd58df41093 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:56 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-03197f66-2fa7-42b8-b1fa-aacd52722ebf req-e40b8b34-c589-4a34-b70c-0dd58df41093 service nova] Creating event network-changed:7f434880-804b-43da-b1ab-5d5e05b5bee1 for instance d25bc2e7-3399-47be-b78d-990acbb51749 on user Apr 12 00:32:56 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-03197f66-2fa7-42b8-b1fa-aacd52722ebf req-e40b8b34-c589-4a34-b70c-0dd58df41093 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035300 Apr 12 00:32:56 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 80/239] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:56 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3d41b83-29fb-497c-b972-2dc29864ff1f"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:56 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:32:56 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:56 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:56 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:56 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:56 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:56 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:57 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-c4659259-8ec8-4cf6-8c43-c04264409012 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274376 Apr 12 00:32:57 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 82/240] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 00:32:56 2023] POST /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:32:57 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-f6ddb7fd-69a4-4955-b37b-bdfb86d2c5ec req-5287db55-71a0-43cc-b9da-9e5625ff9a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-deleted", "tag": "4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-deleted", "tag": "f9be977e-033f-44cb-adda-1590a13ccbdb"}, {"server_uuid": "e3b52368-86be-4211-a37b-522ed3991a00", "name": "network-vif-deleted", "tag": "34faa1f7-7c0e-4272-a3b6-092979dd46b8"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-deleted", "tag": "09b82fec-ca71-4934-ac24-073ca9080c9c"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-deleted", "tag": "bb8ab354-dbbc-4141-9499-5689ae95fb2f"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:32:57 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f6ddb7fd-69a4-4955-b37b-bdfb86d2c5ec req-5287db55-71a0-43cc-b9da-9e5625ff9a95 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:32:57 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f6ddb7fd-69a4-4955-b37b-bdfb86d2c5ec req-5287db55-71a0-43cc-b9da-9e5625ff9a95 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:32:57 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f6ddb7fd-69a4-4955-b37b-bdfb86d2c5ec req-5287db55-71a0-43cc-b9da-9e5625ff9a95 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:32:58 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-f6ddb7fd-69a4-4955-b37b-bdfb86d2c5ec req-5287db55-71a0-43cc-b9da-9e5625ff9a95 service nova] Creating event network-vif-deleted:4a80b7d7-aa4b-4b38-9fa0-f54c555dc0e6 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:32:58 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-f6ddb7fd-69a4-4955-b37b-bdfb86d2c5ec req-5287db55-71a0-43cc-b9da-9e5625ff9a95 service nova] Creating event network-vif-deleted:f9be977e-033f-44cb-adda-1590a13ccbdb for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:32:58 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-f6ddb7fd-69a4-4955-b37b-bdfb86d2c5ec req-5287db55-71a0-43cc-b9da-9e5625ff9a95 service nova] Creating event network-vif-deleted:34faa1f7-7c0e-4272-a3b6-092979dd46b8 for instance e3b52368-86be-4211-a37b-522ed3991a00 on user Apr 12 00:32:58 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-f6ddb7fd-69a4-4955-b37b-bdfb86d2c5ec req-5287db55-71a0-43cc-b9da-9e5625ff9a95 service nova] Creating event network-vif-deleted:09b82fec-ca71-4934-ac24-073ca9080c9c for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:32:58 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-f6ddb7fd-69a4-4955-b37b-bdfb86d2c5ec req-5287db55-71a0-43cc-b9da-9e5625ff9a95 service nova] Creating event network-vif-deleted:bb8ab354-dbbc-4141-9499-5689ae95fb2f for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:32:58 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-f6ddb7fd-69a4-4955-b37b-bdfb86d2c5ec req-5287db55-71a0-43cc-b9da-9e5625ff9a95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.042864 Apr 12 00:32:58 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 79/241] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:32:57 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:00 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-28791bef-d65a-4700-9c11-1e82f601b605 req-1670d707-8f0f-4028-a3db-ff84b8b03df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-deleted", "tag": "9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b"}, {"server_uuid": "f784806a-987f-4861-a23a-dbf961c8b6c1", "name": "network-vif-deleted", "tag": "f528d725-8cc8-49c2-8e45-56340893e4c7"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:00 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-28791bef-d65a-4700-9c11-1e82f601b605 req-1670d707-8f0f-4028-a3db-ff84b8b03df6 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:00 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-28791bef-d65a-4700-9c11-1e82f601b605 req-1670d707-8f0f-4028-a3db-ff84b8b03df6 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:00 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-28791bef-d65a-4700-9c11-1e82f601b605 req-1670d707-8f0f-4028-a3db-ff84b8b03df6 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:00 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-28791bef-d65a-4700-9c11-1e82f601b605 req-1670d707-8f0f-4028-a3db-ff84b8b03df6 service nova] Creating event network-vif-deleted:9d9fcf83-a90e-4979-8c4d-4ab26dc6a02b for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:33:00 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-28791bef-d65a-4700-9c11-1e82f601b605 req-1670d707-8f0f-4028-a3db-ff84b8b03df6 service nova] Creating event network-vif-deleted:f528d725-8cc8-49c2-8e45-56340893e4c7 for instance f784806a-987f-4861-a23a-dbf961c8b6c1 on user Apr 12 00:33:00 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-28791bef-d65a-4700-9c11-1e82f601b605 req-1670d707-8f0f-4028-a3db-ff84b8b03df6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034173 Apr 12 00:33:00 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 81/242] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:33:00 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:05 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:05 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:05 user devstack@n-api.service[72496]: DEBUG nova.objects.instance [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lazy-loading 'services' on Instance uuid d25bc2e7-3399-47be-b78d-990acbb51749 {{(pid=72496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:33:05 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-2aa98d69-ec9f-46c0-9d44-1fb5c161b3b2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749/os-volume_attachments/e3d41b83-29fb-497c-b972-2dc29864ff1f" status: 202 len: 0 microversion: 2.1 time: 0.248018 Apr 12 00:33:05 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 83/243] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 00:33:05 2023] DELETE /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749/os-volume_attachments/e3d41b83-29fb-497c-b972-2dc29864ff1f => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:33:05 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-63783dd6-4e8c-4ff7-8b6f-3ee66fca8cde tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:05 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-63783dd6-4e8c-4ff7-8b6f-3ee66fca8cde tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-63783dd6-4e8c-4ff7-8b6f-3ee66fca8cde tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-63783dd6-4e8c-4ff7-8b6f-3ee66fca8cde tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-63783dd6-4e8c-4ff7-8b6f-3ee66fca8cde tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-63783dd6-4e8c-4ff7-8b6f-3ee66fca8cde tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-63783dd6-4e8c-4ff7-8b6f-3ee66fca8cde tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-63783dd6-4e8c-4ff7-8b6f-3ee66fca8cde tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:05 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-63783dd6-4e8c-4ff7-8b6f-3ee66fca8cde tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054865 Apr 12 00:33:05 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 80/244] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:33:05 2023] GET /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:09 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-95ac0b3a-7ab6-45e7-ae85-62781a5e663d tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:09 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-95ac0b3a-7ab6-45e7-ae85-62781a5e663d tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:09 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-95ac0b3a-7ab6-45e7-ae85-62781a5e663d tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:09 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-95ac0b3a-7ab6-45e7-ae85-62781a5e663d tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:09 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-95ac0b3a-7ab6-45e7-ae85-62781a5e663d tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:09 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-95ac0b3a-7ab6-45e7-ae85-62781a5e663d tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:09 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-95ac0b3a-7ab6-45e7-ae85-62781a5e663d tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:09 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-95ac0b3a-7ab6-45e7-ae85-62781a5e663d tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:09 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-95ac0b3a-7ab6-45e7-ae85-62781a5e663d tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5219586e4e24c33a8cdf52c21d875bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12eca8b17b844a8821294ec9dd19de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:33:09 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-95ac0b3a-7ab6-45e7-ae85-62781a5e663d tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34" status: 200 len: 1568 microversion: 2.1 time: 0.207614 Apr 12 00:33:09 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 82/245] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:33:09 2023] GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34 => generated 1568 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:12 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-eb6e0b3f-3ee0-4fba-a0af-47eac6f0a219 req-9c94b7ce-87d4-4bec-a00f-ea0c8251a6ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d67708d-1bcf-4d32-8d45-22376ec72e34", "tag": "71a3bef9-13f4-4aab-ba85-a26faa225efb"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:12 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-eb6e0b3f-3ee0-4fba-a0af-47eac6f0a219 req-9c94b7ce-87d4-4bec-a00f-ea0c8251a6ee service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:12 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-eb6e0b3f-3ee0-4fba-a0af-47eac6f0a219 req-9c94b7ce-87d4-4bec-a00f-ea0c8251a6ee service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:12 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-eb6e0b3f-3ee0-4fba-a0af-47eac6f0a219 req-9c94b7ce-87d4-4bec-a00f-ea0c8251a6ee service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:12 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-eb6e0b3f-3ee0-4fba-a0af-47eac6f0a219 req-9c94b7ce-87d4-4bec-a00f-ea0c8251a6ee service nova] Creating event network-changed:71a3bef9-13f4-4aab-ba85-a26faa225efb for instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 on user Apr 12 00:33:12 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-eb6e0b3f-3ee0-4fba-a0af-47eac6f0a219 req-9c94b7ce-87d4-4bec-a00f-ea0c8251a6ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041255 Apr 12 00:33:12 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 84/246] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:33:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:12 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43cb1662-3455-4f68-8d31-4beb337e717a"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:12 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:12 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:12 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:12 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:12 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:12 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:12 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:12 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-eda0f0f8-dbf7-4f98-b35e-6bc6d8baf3f6 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277105 Apr 12 00:33:12 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 81/247] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 00:33:12 2023] POST /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:18 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-37415a5f-f618-4794-b045-90c0e69ffb57 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:18 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-37415a5f-f618-4794-b045-90c0e69ffb57 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:18 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=28 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:33:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-37415a5f-f618-4794-b045-90c0e69ffb57 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-37415a5f-f618-4794-b045-90c0e69ffb57 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-37415a5f-f618-4794-b045-90c0e69ffb57 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-37415a5f-f618-4794-b045-90c0e69ffb57 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-37415a5f-f618-4794-b045-90c0e69ffb57 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-37415a5f-f618-4794-b045-90c0e69ffb57 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:18 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:33:18 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-37415a5f-f618-4794-b045-90c0e69ffb57 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391e2cd0c34b4e838c4cf86ba933270c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bc7149e49343889c32fc198b6a0500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:33:18 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-37415a5f-f618-4794-b045-90c0e69ffb57 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff" status: 200 len: 1432 microversion: 2.1 time: 0.171806 Apr 12 00:33:18 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 83/248] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:33:18 2023] GET /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff => generated 1432 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:20 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-35c3e478-95a1-4e0d-ae25-4f9c577e3ed3 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:20 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-35c3e478-95a1-4e0d-ae25-4f9c577e3ed3 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:20 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-babeea15-7d08-4663-a4b3-c4fd5260c2db req-da87253b-e374-4dec-96db-7f498f41afde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19cc71e1-9b01-4bfd-9898-14b04bfe5fff", "tag": "b796ef8b-d964-459f-b12c-9be0133dd643"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:20 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:33:20 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:33:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-35c3e478-95a1-4e0d-ae25-4f9c577e3ed3 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-35c3e478-95a1-4e0d-ae25-4f9c577e3ed3 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-35c3e478-95a1-4e0d-ae25-4f9c577e3ed3 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-35c3e478-95a1-4e0d-ae25-4f9c577e3ed3 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-35c3e478-95a1-4e0d-ae25-4f9c577e3ed3 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-35c3e478-95a1-4e0d-ae25-4f9c577e3ed3 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-babeea15-7d08-4663-a4b3-c4fd5260c2db req-da87253b-e374-4dec-96db-7f498f41afde service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-babeea15-7d08-4663-a4b3-c4fd5260c2db req-da87253b-e374-4dec-96db-7f498f41afde service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-babeea15-7d08-4663-a4b3-c4fd5260c2db req-da87253b-e374-4dec-96db-7f498f41afde service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:20 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:33:20 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:33:20 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-35c3e478-95a1-4e0d-ae25-4f9c577e3ed3 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] HTTP exception thrown: Instance db3a1291-c686-4e29-8499-8d49dd74a7bb could not be found. Apr 12 00:33:20 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-35c3e478-95a1-4e0d-ae25-4f9c577e3ed3 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Request method failure captured: Apr 12 00:33:20 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb HTTP/1.1 Apr 12 00:33:20 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:33:20 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:33:20 user devstack@n-api.service[72496]: Connection: close Apr 12 00:33:20 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:33:20 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:33:20 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:33:20 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:33:20 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:33:20 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNft8b4SwuCnbXHRKFDNl7isWgrgGkZKGrZlrXYdAJz7aX4zS1jjCBboyIsQJw68wEwRdESiI6NBGFpLqHL7Bb3ViqrhRWhLzNQCPnr_ob9vIpgJsW_EY-xBTloqVJWqDt-MjgavIdFpRkmVZx2M3gUiY2O1nAUa8gO3GGQds0K9_rBg Apr 12 00:33:20 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:33:20 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:33:20 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:33:20 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:33:20 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:33:20 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:33:20 user devstack@n-api.service[72496]: X-Project-Id: 88cf7bd87e954fa892ea0da5332a6589 Apr 12 00:33:20 user devstack@n-api.service[72496]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-540615201 Apr 12 00:33:20 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:33:20 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:33:20 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88cf7bd87e954fa892ea0da5332a6589"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88cf7bd87e954fa892ea0da5332a6589"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88cf7bd87e954fa892ea0da5332a6589"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:33:20 user devstack@n-api.service[72496]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-540615201 Apr 12 00:33:20 user devstack@n-api.service[72496]: X-Tenant-Id: 88cf7bd87e954fa892ea0da5332a6589 Apr 12 00:33:20 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-540615201 Apr 12 00:33:20 user devstack@n-api.service[72496]: X-User: tempest-AttachSCSIVolumeTestJSON-540615201-project-member Apr 12 00:33:20 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:33:20 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:33:20 user devstack@n-api.service[72496]: X-User-Id: 31fe897a730b44bb8c8bf9d92938bc9b Apr 12 00:33:20 user devstack@n-api.service[72496]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-540615201-project-member Apr 12 00:33:20 user devstack@n-api.service[72496]: method: > Apr 12 00:33:20 user devstack@n-api.service[72496]: exception: Instance db3a1291-c686-4e29-8499-8d49dd74a7bb could not be found. Apr 12 00:33:20 user devstack@n-api.service[72496]: action_args: {'id': 'db3a1291-c686-4e29-8499-8d49dd74a7bb'} Apr 12 00:33:20 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db3a1291-c686-4e29-8499-8d49dd74a7bb could not be found. Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db3a1291-c686-4e29-8499-8d49dd74a7bb could not be found. Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db3a1291-c686-4e29-8499-8d49dd74a7bb could not be found. Apr 12 00:33:20 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:20 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-babeea15-7d08-4663-a4b3-c4fd5260c2db req-da87253b-e374-4dec-96db-7f498f41afde service nova] Creating event network-changed:b796ef8b-d964-459f-b12c-9be0133dd643 for instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff on user Apr 12 00:33:20 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-35c3e478-95a1-4e0d-ae25-4f9c577e3ed3 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Returning 404 to user: Instance db3a1291-c686-4e29-8499-8d49dd74a7bb could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:33:20 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-35c3e478-95a1-4e0d-ae25-4f9c577e3ed3 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb" status: 404 len: 111 microversion: 2.1 time: 0.045579 Apr 12 00:33:20 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 85/249] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:33:20 2023] GET /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:33:20 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-babeea15-7d08-4663-a4b3-c4fd5260c2db req-da87253b-e374-4dec-96db-7f498f41afde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044487 Apr 12 00:33:20 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 82/250] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:33:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:20 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-5121253c-231b-48db-99b3-e87847d2edca tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Calling method '.version_select at 0x7f7cd4bb1ab0>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:20 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-5121253c-231b-48db-99b3-e87847d2edca tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-992126776" status: 202 len: 0 microversion: 2.1 time: 0.031675 Apr 12 00:33:20 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 84/251] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 00:33:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-992126776 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:33:20 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:20 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:20 user devstack@n-api.service[72496]: DEBUG nova.objects.instance [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lazy-loading 'flavor' on Instance uuid 19cc71e1-9b01-4bfd-9898-14b04bfe5fff {{(pid=72496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:33:20 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-ae0f5918-301b-405c-98e7-3d0f61613e0d tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] 10.0.0.210 "POST /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff/action" status: 202 len: 0 microversion: 2.1 time: 0.205738 Apr 12 00:33:20 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 86/252] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 00:33:20 2023] POST /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:33:20 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-e1ba0e38-a97a-4647-aefe-7b6007bc33c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:20 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-e1ba0e38-a97a-4647-aefe-7b6007bc33c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e1ba0e38-a97a-4647-aefe-7b6007bc33c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e1ba0e38-a97a-4647-aefe-7b6007bc33c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e1ba0e38-a97a-4647-aefe-7b6007bc33c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e1ba0e38-a97a-4647-aefe-7b6007bc33c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e1ba0e38-a97a-4647-aefe-7b6007bc33c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e1ba0e38-a97a-4647-aefe-7b6007bc33c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:21 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-e1ba0e38-a97a-4647-aefe-7b6007bc33c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391e2cd0c34b4e838c4cf86ba933270c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bc7149e49343889c32fc198b6a0500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:33:21 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-e1ba0e38-a97a-4647-aefe-7b6007bc33c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff" status: 200 len: 1556 microversion: 2.1 time: 0.311622 Apr 12 00:33:21 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 83/253] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:33:20 2023] GET /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff => generated 1556 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:22 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-fc6e87a0-4f01-421a-b155-242bbd93ab86 req-5c3bbe0d-bd67-4cd5-ac14-499d0bb99310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19cc71e1-9b01-4bfd-9898-14b04bfe5fff", "name": "network-vif-unplugged", "status": "completed", "tag": "b796ef8b-d964-459f-b12c-9be0133dd643"}, {"server_uuid": "19cc71e1-9b01-4bfd-9898-14b04bfe5fff", "name": "network-vif-plugged", "status": "completed", "tag": "b796ef8b-d964-459f-b12c-9be0133dd643"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:22 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-fc6e87a0-4f01-421a-b155-242bbd93ab86 req-5c3bbe0d-bd67-4cd5-ac14-499d0bb99310 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:22 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-fc6e87a0-4f01-421a-b155-242bbd93ab86 req-5c3bbe0d-bd67-4cd5-ac14-499d0bb99310 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:22 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-fc6e87a0-4f01-421a-b155-242bbd93ab86 req-5c3bbe0d-bd67-4cd5-ac14-499d0bb99310 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:22 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-fc6e87a0-4f01-421a-b155-242bbd93ab86 req-5c3bbe0d-bd67-4cd5-ac14-499d0bb99310 service nova] Creating event network-vif-unplugged:b796ef8b-d964-459f-b12c-9be0133dd643 for instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff on user Apr 12 00:33:22 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-fc6e87a0-4f01-421a-b155-242bbd93ab86 req-5c3bbe0d-bd67-4cd5-ac14-499d0bb99310 service nova] Creating event network-vif-plugged:b796ef8b-d964-459f-b12c-9be0133dd643 for instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff on user Apr 12 00:33:22 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-fc6e87a0-4f01-421a-b155-242bbd93ab86 req-5c3bbe0d-bd67-4cd5-ac14-499d0bb99310 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.033011 Apr 12 00:33:22 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 85/254] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:33:22 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:22 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-99a36655-0c90-40e6-96ec-64ebb374478e req-2c8afb10-ca49-4442-80bb-b1fcb8b51f92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19cc71e1-9b01-4bfd-9898-14b04bfe5fff", "tag": "b796ef8b-d964-459f-b12c-9be0133dd643"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-99a36655-0c90-40e6-96ec-64ebb374478e req-2c8afb10-ca49-4442-80bb-b1fcb8b51f92 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-99a36655-0c90-40e6-96ec-64ebb374478e req-2c8afb10-ca49-4442-80bb-b1fcb8b51f92 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-99a36655-0c90-40e6-96ec-64ebb374478e req-2c8afb10-ca49-4442-80bb-b1fcb8b51f92 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:22 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-99a36655-0c90-40e6-96ec-64ebb374478e req-2c8afb10-ca49-4442-80bb-b1fcb8b51f92 service nova] Creating event network-changed:b796ef8b-d964-459f-b12c-9be0133dd643 for instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff on user Apr 12 00:33:23 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-99a36655-0c90-40e6-96ec-64ebb374478e req-2c8afb10-ca49-4442-80bb-b1fcb8b51f92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075684 Apr 12 00:33:23 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 87/255] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:33:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:24 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-f97dc5d5-7e5b-41c5-95af-4cc8bc3a50f8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:24 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-f97dc5d5-7e5b-41c5-95af-4cc8bc3a50f8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f97dc5d5-7e5b-41c5-95af-4cc8bc3a50f8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f97dc5d5-7e5b-41c5-95af-4cc8bc3a50f8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f97dc5d5-7e5b-41c5-95af-4cc8bc3a50f8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f97dc5d5-7e5b-41c5-95af-4cc8bc3a50f8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f97dc5d5-7e5b-41c5-95af-4cc8bc3a50f8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f97dc5d5-7e5b-41c5-95af-4cc8bc3a50f8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:24 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-f97dc5d5-7e5b-41c5-95af-4cc8bc3a50f8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] HTTP exception thrown: Instance db3a1291-c686-4e29-8499-8d49dd74a7bb could not be found. Apr 12 00:33:24 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-f97dc5d5-7e5b-41c5-95af-4cc8bc3a50f8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Request method failure captured: Apr 12 00:33:24 user devstack@n-api.service[72494]: request: DELETE /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb HTTP/1.1 Apr 12 00:33:24 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:33:24 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:33:24 user devstack@n-api.service[72494]: Connection: close Apr 12 00:33:24 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:33:24 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:33:24 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:33:24 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:33:24 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:33:24 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNft8b4SwuCnbXHRKFDNl7isWgrgGkZKGrZlrXYdAJz7aX4zS1jjCBboyIsQJw68wEwRdESiI6NBGFpLqHL7Bb3ViqrhRWhLzNQCPnr_ob9vIpgJsW_EY-xBTloqVJWqDt-MjgavIdFpRkmVZx2M3gUiY2O1nAUa8gO3GGQds0K9_rBg Apr 12 00:33:24 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:33:24 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:33:24 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:33:24 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:33:24 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:33:24 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:33:24 user devstack@n-api.service[72494]: X-Project-Id: 88cf7bd87e954fa892ea0da5332a6589 Apr 12 00:33:24 user devstack@n-api.service[72494]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-540615201 Apr 12 00:33:24 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:33:24 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:33:24 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88cf7bd87e954fa892ea0da5332a6589"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88cf7bd87e954fa892ea0da5332a6589"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88cf7bd87e954fa892ea0da5332a6589"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:33:24 user devstack@n-api.service[72494]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-540615201 Apr 12 00:33:24 user devstack@n-api.service[72494]: X-Tenant-Id: 88cf7bd87e954fa892ea0da5332a6589 Apr 12 00:33:24 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-540615201 Apr 12 00:33:24 user devstack@n-api.service[72494]: X-User: tempest-AttachSCSIVolumeTestJSON-540615201-project-member Apr 12 00:33:24 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:33:24 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:33:24 user devstack@n-api.service[72494]: X-User-Id: 31fe897a730b44bb8c8bf9d92938bc9b Apr 12 00:33:24 user devstack@n-api.service[72494]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-540615201-project-member Apr 12 00:33:24 user devstack@n-api.service[72494]: method: > Apr 12 00:33:24 user devstack@n-api.service[72494]: exception: Instance db3a1291-c686-4e29-8499-8d49dd74a7bb could not be found. Apr 12 00:33:24 user devstack@n-api.service[72494]: action_args: {'id': 'db3a1291-c686-4e29-8499-8d49dd74a7bb'} Apr 12 00:33:24 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db3a1291-c686-4e29-8499-8d49dd74a7bb could not be found. Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db3a1291-c686-4e29-8499-8d49dd74a7bb could not be found. Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db3a1291-c686-4e29-8499-8d49dd74a7bb could not be found. Apr 12 00:33:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:33:24 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-f97dc5d5-7e5b-41c5-95af-4cc8bc3a50f8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Returning 404 to user: Instance db3a1291-c686-4e29-8499-8d49dd74a7bb could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:33:24 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-f97dc5d5-7e5b-41c5-95af-4cc8bc3a50f8 tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb" status: 404 len: 111 microversion: 2.1 time: 0.043060 Apr 12 00:33:24 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 84/256] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:33:24 2023] DELETE /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:33:24 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-573b0f9d-e355-45a1-907b-91e76d17ed4f tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:24 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-573b0f9d-e355-45a1-907b-91e76d17ed4f tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] [instance: db3a1291-c686-4e29-8499-8d49dd74a7bb] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-573b0f9d-e355-45a1-907b-91e76d17ed4f tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-573b0f9d-e355-45a1-907b-91e76d17ed4f tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-573b0f9d-e355-45a1-907b-91e76d17ed4f tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-573b0f9d-e355-45a1-907b-91e76d17ed4f tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-573b0f9d-e355-45a1-907b-91e76d17ed4f tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-573b0f9d-e355-45a1-907b-91e76d17ed4f tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:24 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-573b0f9d-e355-45a1-907b-91e76d17ed4f tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] HTTP exception thrown: Instance db3a1291-c686-4e29-8499-8d49dd74a7bb could not be found. Apr 12 00:33:24 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-573b0f9d-e355-45a1-907b-91e76d17ed4f tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Request method failure captured: Apr 12 00:33:24 user devstack@n-api.service[72495]: request: GET /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb HTTP/1.1 Apr 12 00:33:24 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:33:24 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:33:24 user devstack@n-api.service[72495]: Connection: close Apr 12 00:33:24 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 00:33:24 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:33:24 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:33:24 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:33:24 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:33:24 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNft8b4SwuCnbXHRKFDNl7isWgrgGkZKGrZlrXYdAJz7aX4zS1jjCBboyIsQJw68wEwRdESiI6NBGFpLqHL7Bb3ViqrhRWhLzNQCPnr_ob9vIpgJsW_EY-xBTloqVJWqDt-MjgavIdFpRkmVZx2M3gUiY2O1nAUa8gO3GGQds0K9_rBg Apr 12 00:33:24 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:33:24 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:33:24 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:33:24 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:33:24 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:33:24 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:33:24 user devstack@n-api.service[72495]: X-Project-Id: 88cf7bd87e954fa892ea0da5332a6589 Apr 12 00:33:24 user devstack@n-api.service[72495]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-540615201 Apr 12 00:33:24 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:33:24 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:33:24 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88cf7bd87e954fa892ea0da5332a6589"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88cf7bd87e954fa892ea0da5332a6589"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88cf7bd87e954fa892ea0da5332a6589"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:33:24 user devstack@n-api.service[72495]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-540615201 Apr 12 00:33:24 user devstack@n-api.service[72495]: X-Tenant-Id: 88cf7bd87e954fa892ea0da5332a6589 Apr 12 00:33:24 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-540615201 Apr 12 00:33:24 user devstack@n-api.service[72495]: X-User: tempest-AttachSCSIVolumeTestJSON-540615201-project-member Apr 12 00:33:24 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:33:24 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:33:24 user devstack@n-api.service[72495]: X-User-Id: 31fe897a730b44bb8c8bf9d92938bc9b Apr 12 00:33:24 user devstack@n-api.service[72495]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-540615201-project-member Apr 12 00:33:24 user devstack@n-api.service[72495]: method: > Apr 12 00:33:24 user devstack@n-api.service[72495]: exception: Instance db3a1291-c686-4e29-8499-8d49dd74a7bb could not be found. Apr 12 00:33:24 user devstack@n-api.service[72495]: action_args: {'id': 'db3a1291-c686-4e29-8499-8d49dd74a7bb'} Apr 12 00:33:24 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db3a1291-c686-4e29-8499-8d49dd74a7bb could not be found. Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db3a1291-c686-4e29-8499-8d49dd74a7bb could not be found. Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db3a1291-c686-4e29-8499-8d49dd74a7bb could not be found. Apr 12 00:33:24 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:33:24 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-573b0f9d-e355-45a1-907b-91e76d17ed4f tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] Returning 404 to user: Instance db3a1291-c686-4e29-8499-8d49dd74a7bb could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:33:24 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-573b0f9d-e355-45a1-907b-91e76d17ed4f tempest-AttachSCSIVolumeTestJSON-540615201 tempest-AttachSCSIVolumeTestJSON-540615201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb" status: 404 len: 111 microversion: 2.1 time: 0.056114 Apr 12 00:33:24 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 86/257] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:33:24 2023] GET /compute/v2.1/servers/db3a1291-c686-4e29-8499-8d49dd74a7bb => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:33:25 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-de2880ca-f3c9-4124-8048-5b96cc06be8b tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:25 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-de2880ca-f3c9-4124-8048-5b96cc06be8b tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-de2880ca-f3c9-4124-8048-5b96cc06be8b tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-de2880ca-f3c9-4124-8048-5b96cc06be8b tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-de2880ca-f3c9-4124-8048-5b96cc06be8b tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-de2880ca-f3c9-4124-8048-5b96cc06be8b tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-de2880ca-f3c9-4124-8048-5b96cc06be8b tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-de2880ca-f3c9-4124-8048-5b96cc06be8b tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:25 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-de2880ca-f3c9-4124-8048-5b96cc06be8b tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097/os-instance-actions/req-797837f9-e52c-41ba-8e5d-a56365dd8e8d" status: 200 len: 503 microversion: 2.49 time: 0.069455 Apr 12 00:33:25 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 88/258] 10.0.0.210 () {64 vars in 1537 bytes} [Wed Apr 12 00:33:25 2023] GET /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097/os-instance-actions/req-797837f9-e52c-41ba-8e5d-a56365dd8e8d => generated 503 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:33:25 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-9b8370e6-9080-49a7-8bb6-bf5d137ee3b1 tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:25 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-9b8370e6-9080-49a7-8bb6-bf5d137ee3b1 tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9b8370e6-9080-49a7-8bb6-bf5d137ee3b1 tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9b8370e6-9080-49a7-8bb6-bf5d137ee3b1 tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9b8370e6-9080-49a7-8bb6-bf5d137ee3b1 tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9b8370e6-9080-49a7-8bb6-bf5d137ee3b1 tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9b8370e6-9080-49a7-8bb6-bf5d137ee3b1 tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9b8370e6-9080-49a7-8bb6-bf5d137ee3b1 tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:25 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-9b8370e6-9080-49a7-8bb6-bf5d137ee3b1 tempest-TaggedAttachmentsTest-2093068670 tempest-TaggedAttachmentsTest-2093068670-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097/os-instance-actions/req-797837f9-e52c-41ba-8e5d-a56365dd8e8d" status: 200 len: 503 microversion: 2.49 time: 0.095658 Apr 12 00:33:25 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 85/259] 10.0.0.210 () {64 vars in 1537 bytes} [Wed Apr 12 00:33:25 2023] GET /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097/os-instance-actions/req-797837f9-e52c-41ba-8e5d-a56365dd8e8d => generated 503 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:33:26 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-dac23c9a-6853-4dd6-a19b-1395ab8ceecb tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:26 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-dac23c9a-6853-4dd6-a19b-1395ab8ceecb tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dac23c9a-6853-4dd6-a19b-1395ab8ceecb tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dac23c9a-6853-4dd6-a19b-1395ab8ceecb tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dac23c9a-6853-4dd6-a19b-1395ab8ceecb tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dac23c9a-6853-4dd6-a19b-1395ab8ceecb tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dac23c9a-6853-4dd6-a19b-1395ab8ceecb tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dac23c9a-6853-4dd6-a19b-1395ab8ceecb tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:26 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-dac23c9a-6853-4dd6-a19b-1395ab8ceecb tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.046504 Apr 12 00:33:26 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 87/260] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 00:33:26 2023] GET /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:26 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:26 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:26 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:26 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:26 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:26 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:26 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:26 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:26 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Going to try to terminate instance {{(pid=72496) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Going to try to terminate instance {{(pid=72494) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:33:26 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-92ab67d6-60dd-4d01-8d09-2d533edf8e53 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097" status: 204 len: 0 microversion: 2.49 time: 0.116353 Apr 12 00:33:26 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 86/261] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 00:33:26 2023] DELETE /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 00:33:26 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-9dabc279-1e4a-4f2b-a292-5ff9a7bd5f32 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/570abef1-f803-4f3e-8051-b6f690063496" status: 204 len: 0 microversion: 2.1 time: 0.138000 Apr 12 00:33:26 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 89/262] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:33:26 2023] DELETE /compute/v2.1/servers/570abef1-f803-4f3e-8051-b6f690063496 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:33:26 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-bd25c40d-2360-422e-8156-70723ab3f8f9 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:26 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-bd25c40d-2360-422e-8156-70723ab3f8f9 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-bd25c40d-2360-422e-8156-70723ab3f8f9 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-bd25c40d-2360-422e-8156-70723ab3f8f9 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-bd25c40d-2360-422e-8156-70723ab3f8f9 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-bd25c40d-2360-422e-8156-70723ab3f8f9 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-bd25c40d-2360-422e-8156-70723ab3f8f9 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-bd25c40d-2360-422e-8156-70723ab3f8f9 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-2c5600e6-b6b9-4bd4-ac62-67846e4dad6f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-2c5600e6-b6b9-4bd4-ac62-67846e4dad6f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2c5600e6-b6b9-4bd4-ac62-67846e4dad6f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2c5600e6-b6b9-4bd4-ac62-67846e4dad6f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2c5600e6-b6b9-4bd4-ac62-67846e4dad6f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2c5600e6-b6b9-4bd4-ac62-67846e4dad6f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2c5600e6-b6b9-4bd4-ac62-67846e4dad6f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2c5600e6-b6b9-4bd4-ac62-67846e4dad6f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:26 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-bd25c40d-2360-422e-8156-70723ab3f8f9 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dae26de34e047b8b4fe08b2e56a4b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7abb0634c7c44699a5197b9876b612c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:33:26 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-bd25c40d-2360-422e-8156-70723ab3f8f9 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3dae26de34e047b8b4fe08b2e56a4b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7abb0634c7c44699a5197b9876b612c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:33:26 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-bd25c40d-2360-422e-8156-70723ab3f8f9 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3dae26de34e047b8b4fe08b2e56a4b62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7abb0634c7c44699a5197b9876b612c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:33:26 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-bd25c40d-2360-422e-8156-70723ab3f8f9 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097" status: 200 len: 1752 microversion: 2.49 time: 0.292310 Apr 12 00:33:26 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 88/263] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:33:26 2023] GET /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097 => generated 1752 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:33:26 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-247b7977-3352-44d4-9353-46bb67aeafc5 req-3b4a7c42-80f8-4822-aff4-b7acb4783f81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570abef1-f803-4f3e-8051-b6f690063496", "name": "network-vif-unplugged", "status": "completed", "tag": "6e0b9ee8-e941-48ea-9659-8e837577d4bb"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:26 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-247b7977-3352-44d4-9353-46bb67aeafc5 req-3b4a7c42-80f8-4822-aff4-b7acb4783f81 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:26 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-247b7977-3352-44d4-9353-46bb67aeafc5 req-3b4a7c42-80f8-4822-aff4-b7acb4783f81 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:26 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-247b7977-3352-44d4-9353-46bb67aeafc5 req-3b4a7c42-80f8-4822-aff4-b7acb4783f81 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-2c5600e6-b6b9-4bd4-ac62-67846e4dad6f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920d6d79e38e45fcb5153e712605764f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee31cdc6f4e4c2b9a8ec1e1c5076010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:33:26 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-247b7977-3352-44d4-9353-46bb67aeafc5 req-3b4a7c42-80f8-4822-aff4-b7acb4783f81 service nova] Creating event network-vif-unplugged:6e0b9ee8-e941-48ea-9659-8e837577d4bb for instance 570abef1-f803-4f3e-8051-b6f690063496 on user Apr 12 00:33:26 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-2c5600e6-b6b9-4bd4-ac62-67846e4dad6f tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] 10.0.0.210 "GET /compute/v2.1/servers/570abef1-f803-4f3e-8051-b6f690063496" status: 200 len: 1498 microversion: 2.1 time: 0.365043 Apr 12 00:33:26 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 87/264] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:33:26 2023] GET /compute/v2.1/servers/570abef1-f803-4f3e-8051-b6f690063496 => generated 1498 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:26 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-247b7977-3352-44d4-9353-46bb67aeafc5 req-3b4a7c42-80f8-4822-aff4-b7acb4783f81 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035464 Apr 12 00:33:26 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 90/265] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:33:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:26 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-3799788e-8447-4fcd-9d76-9ee76d7109f6 req-8d262446-96c1-43f9-bb2b-af7a2e275e8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9dc12da-4db1-4305-93ea-2bd63870c097", "name": "network-vif-unplugged", "status": "completed", "tag": "47b92afd-7a5c-49a0-aea8-abccac5e350c"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3799788e-8447-4fcd-9d76-9ee76d7109f6 req-8d262446-96c1-43f9-bb2b-af7a2e275e8b service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3799788e-8447-4fcd-9d76-9ee76d7109f6 req-8d262446-96c1-43f9-bb2b-af7a2e275e8b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3799788e-8447-4fcd-9d76-9ee76d7109f6 req-8d262446-96c1-43f9-bb2b-af7a2e275e8b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:26 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-3799788e-8447-4fcd-9d76-9ee76d7109f6 req-8d262446-96c1-43f9-bb2b-af7a2e275e8b service nova] Creating event network-vif-unplugged:47b92afd-7a5c-49a0-aea8-abccac5e350c for instance f9dc12da-4db1-4305-93ea-2bd63870c097 on user Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:26 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-3799788e-8447-4fcd-9d76-9ee76d7109f6 req-8d262446-96c1-43f9-bb2b-af7a2e275e8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032531 Apr 12 00:33:26 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 89/266] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:33:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:26 user devstack@n-api.service[72494]: DEBUG nova.objects.instance [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lazy-loading 'services' on Instance uuid 9d67708d-1bcf-4d32-8d45-22376ec72e34 {{(pid=72494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:33:26 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-b3020ae3-7d9d-4232-aac0-e925396b8c84 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments/43cb1662-3455-4f68-8d31-4beb337e717a" status: 202 len: 0 microversion: 2.1 time: 0.224836 Apr 12 00:33:26 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 88/267] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 00:33:26 2023] DELETE /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments/43cb1662-3455-4f68-8d31-4beb337e717a => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:33:26 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-8389241d-4bac-41a7-9f10-2b732a6d6b57 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:26 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-8389241d-4bac-41a7-9f10-2b732a6d6b57 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:26 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8389241d-4bac-41a7-9f10-2b732a6d6b57 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:26 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8389241d-4bac-41a7-9f10-2b732a6d6b57 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:26 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8389241d-4bac-41a7-9f10-2b732a6d6b57 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:26 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8389241d-4bac-41a7-9f10-2b732a6d6b57 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:26 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8389241d-4bac-41a7-9f10-2b732a6d6b57 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:26 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8389241d-4bac-41a7-9f10-2b732a6d6b57 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:26 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-8389241d-4bac-41a7-9f10-2b732a6d6b57 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048924 Apr 12 00:33:26 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 91/268] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:33:26 2023] GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:28 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-d55a52e4-5b4b-41f5-9000-66b775e957ac req-3a2beebc-ec98-4a65-a454-20dbaff6bdb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570abef1-f803-4f3e-8051-b6f690063496", "name": "network-vif-plugged", "status": "completed", "tag": "6e0b9ee8-e941-48ea-9659-8e837577d4bb"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d55a52e4-5b4b-41f5-9000-66b775e957ac req-3a2beebc-ec98-4a65-a454-20dbaff6bdb0 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d55a52e4-5b4b-41f5-9000-66b775e957ac req-3a2beebc-ec98-4a65-a454-20dbaff6bdb0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d55a52e4-5b4b-41f5-9000-66b775e957ac req-3a2beebc-ec98-4a65-a454-20dbaff6bdb0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:28 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-d55a52e4-5b4b-41f5-9000-66b775e957ac req-3a2beebc-ec98-4a65-a454-20dbaff6bdb0 service nova] Creating event network-vif-plugged:6e0b9ee8-e941-48ea-9659-8e837577d4bb for instance 570abef1-f803-4f3e-8051-b6f690063496 on user Apr 12 00:33:28 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-d55a52e4-5b4b-41f5-9000-66b775e957ac req-3a2beebc-ec98-4a65-a454-20dbaff6bdb0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036240 Apr 12 00:33:28 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 90/269] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:33:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:28 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-68dfa85b-6737-4cbf-8181-3795a878c6a1 req-ff1d84d0-e35e-426f-8a5f-8cc2b152180e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9dc12da-4db1-4305-93ea-2bd63870c097", "name": "network-vif-plugged", "status": "completed", "tag": "47b92afd-7a5c-49a0-aea8-abccac5e350c"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:28 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-68dfa85b-6737-4cbf-8181-3795a878c6a1 req-ff1d84d0-e35e-426f-8a5f-8cc2b152180e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:28 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-68dfa85b-6737-4cbf-8181-3795a878c6a1 req-ff1d84d0-e35e-426f-8a5f-8cc2b152180e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:28 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-68dfa85b-6737-4cbf-8181-3795a878c6a1 req-ff1d84d0-e35e-426f-8a5f-8cc2b152180e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:28 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-68dfa85b-6737-4cbf-8181-3795a878c6a1 req-ff1d84d0-e35e-426f-8a5f-8cc2b152180e service nova] Creating event network-vif-plugged:47b92afd-7a5c-49a0-aea8-abccac5e350c for instance f9dc12da-4db1-4305-93ea-2bd63870c097 on user Apr 12 00:33:28 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-68dfa85b-6737-4cbf-8181-3795a878c6a1 req-ff1d84d0-e35e-426f-8a5f-8cc2b152180e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034179 Apr 12 00:33:28 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 89/270] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:33:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:29 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-f6fd433c-a195-47f4-a2cb-4590374db0d1 req-f90cc8ef-b9fc-4cdd-88a6-1537531f0fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570abef1-f803-4f3e-8051-b6f690063496", "name": "network-vif-deleted", "tag": "6e0b9ee8-e941-48ea-9659-8e837577d4bb"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-f6fd433c-a195-47f4-a2cb-4590374db0d1 req-f90cc8ef-b9fc-4cdd-88a6-1537531f0fae service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-f6fd433c-a195-47f4-a2cb-4590374db0d1 req-f90cc8ef-b9fc-4cdd-88a6-1537531f0fae service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-f6fd433c-a195-47f4-a2cb-4590374db0d1 req-f90cc8ef-b9fc-4cdd-88a6-1537531f0fae service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:29 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-f6fd433c-a195-47f4-a2cb-4590374db0d1 req-f90cc8ef-b9fc-4cdd-88a6-1537531f0fae service nova] Creating event network-vif-deleted:6e0b9ee8-e941-48ea-9659-8e837577d4bb for instance 570abef1-f803-4f3e-8051-b6f690063496 on user Apr 12 00:33:29 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-f6fd433c-a195-47f4-a2cb-4590374db0d1 req-f90cc8ef-b9fc-4cdd-88a6-1537531f0fae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034987 Apr 12 00:33:29 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 92/271] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:33:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:31 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-62698442-3961-466c-8660-04d08bb2f268 req-dbd21632-fe04-4830-ab5a-6806af79084f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9dc12da-4db1-4305-93ea-2bd63870c097", "name": "network-vif-deleted", "tag": "47b92afd-7a5c-49a0-aea8-abccac5e350c"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-62698442-3961-466c-8660-04d08bb2f268 req-dbd21632-fe04-4830-ab5a-6806af79084f service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-62698442-3961-466c-8660-04d08bb2f268 req-dbd21632-fe04-4830-ab5a-6806af79084f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-62698442-3961-466c-8660-04d08bb2f268 req-dbd21632-fe04-4830-ab5a-6806af79084f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:31 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-62698442-3961-466c-8660-04d08bb2f268 req-dbd21632-fe04-4830-ab5a-6806af79084f service nova] Creating event network-vif-deleted:47b92afd-7a5c-49a0-aea8-abccac5e350c for instance f9dc12da-4db1-4305-93ea-2bd63870c097 on user Apr 12 00:33:31 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-62698442-3961-466c-8660-04d08bb2f268 req-dbd21632-fe04-4830-ab5a-6806af79084f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029097 Apr 12 00:33:31 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 91/272] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:33:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:31 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-fdb10161-7cf3-40ed-a326-11ed31176905 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:31 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-fdb10161-7cf3-40ed-a326-11ed31176905 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:31 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fdb10161-7cf3-40ed-a326-11ed31176905 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:31 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fdb10161-7cf3-40ed-a326-11ed31176905 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:31 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fdb10161-7cf3-40ed-a326-11ed31176905 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:31 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fdb10161-7cf3-40ed-a326-11ed31176905 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:31 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fdb10161-7cf3-40ed-a326-11ed31176905 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:31 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fdb10161-7cf3-40ed-a326-11ed31176905 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:31 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-fdb10161-7cf3-40ed-a326-11ed31176905 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9421443b2f421298a934122c6a8b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf1fea74ef143e6b394e41e7c4ed495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:33:31 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-fdb10161-7cf3-40ed-a326-11ed31176905 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0" status: 200 len: 1503 microversion: 2.1 time: 0.154807 Apr 12 00:33:31 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 90/273] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:33:31 2023] GET /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:35 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-16e2fd5c-ed9b-4ad9-8b97-adf100f8f65f tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:35 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-16e2fd5c-ed9b-4ad9-8b97-adf100f8f65f tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-16e2fd5c-ed9b-4ad9-8b97-adf100f8f65f tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-16e2fd5c-ed9b-4ad9-8b97-adf100f8f65f tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-16e2fd5c-ed9b-4ad9-8b97-adf100f8f65f tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-16e2fd5c-ed9b-4ad9-8b97-adf100f8f65f tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-16e2fd5c-ed9b-4ad9-8b97-adf100f8f65f tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-16e2fd5c-ed9b-4ad9-8b97-adf100f8f65f tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:35 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-16e2fd5c-ed9b-4ad9-8b97-adf100f8f65f tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] HTTP exception thrown: Instance e3b52368-86be-4211-a37b-522ed3991a00 could not be found. Apr 12 00:33:35 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-16e2fd5c-ed9b-4ad9-8b97-adf100f8f65f tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Request method failure captured: Apr 12 00:33:35 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/e3b52368-86be-4211-a37b-522ed3991a00 HTTP/1.1 Apr 12 00:33:35 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:33:35 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:33:35 user devstack@n-api.service[72496]: Connection: close Apr 12 00:33:35 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:33:35 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:33:35 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:33:35 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:33:35 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:33:35 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNft6CrpqaIjyISvOScQBb593z9lJN22U4zvqCVS59VNpsZzGuSh7aDN1HxE9m7hdNUViJ4kpBScBj-gCu1qE2UoIUJcEPxKxIwenUnE7I1ToJoYUyfLwIFYYOqZWF9Jhprg0nx70r97xAcx0JIF2gwdcXUZGgYP7QaaJrrUKWkD0zKY Apr 12 00:33:35 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:33:35 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:33:35 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:33:35 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:33:35 user devstack@n-api.service[72496]: X-Openstack-Nova-Api-Version: 2.42 Apr 12 00:33:35 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:33:35 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:33:35 user devstack@n-api.service[72496]: X-Project-Id: c45d99a301794a748dadf4c96860835c Apr 12 00:33:35 user devstack@n-api.service[72496]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2057856153 Apr 12 00:33:35 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:33:35 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:33:35 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c45d99a301794a748dadf4c96860835c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c45d99a301794a748dadf4c96860835c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c45d99a301794a748dadf4c96860835c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:33:35 user devstack@n-api.service[72496]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2057856153 Apr 12 00:33:35 user devstack@n-api.service[72496]: X-Tenant-Id: c45d99a301794a748dadf4c96860835c Apr 12 00:33:35 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2057856153 Apr 12 00:33:35 user devstack@n-api.service[72496]: X-User: tempest-TaggedBootDevicesTest_v242-2057856153-project-member Apr 12 00:33:35 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:33:35 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:33:35 user devstack@n-api.service[72496]: X-User-Id: 846fa2a73bbb4036ad3fb19afc811131 Apr 12 00:33:35 user devstack@n-api.service[72496]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2057856153-project-member Apr 12 00:33:35 user devstack@n-api.service[72496]: method: > Apr 12 00:33:35 user devstack@n-api.service[72496]: exception: Instance e3b52368-86be-4211-a37b-522ed3991a00 could not be found. Apr 12 00:33:35 user devstack@n-api.service[72496]: action_args: {'id': 'e3b52368-86be-4211-a37b-522ed3991a00'} Apr 12 00:33:35 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3b52368-86be-4211-a37b-522ed3991a00 could not be found. Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3b52368-86be-4211-a37b-522ed3991a00 could not be found. Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3b52368-86be-4211-a37b-522ed3991a00 could not be found. Apr 12 00:33:35 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:35 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-16e2fd5c-ed9b-4ad9-8b97-adf100f8f65f tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Returning 404 to user: Instance e3b52368-86be-4211-a37b-522ed3991a00 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:33:35 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-16e2fd5c-ed9b-4ad9-8b97-adf100f8f65f tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3b52368-86be-4211-a37b-522ed3991a00" status: 404 len: 111 microversion: 2.42 time: 0.031904 Apr 12 00:33:35 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 93/274] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:33:35 2023] GET /compute/v2.1/servers/e3b52368-86be-4211-a37b-522ed3991a00 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:33:35 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-6922a4db-d2e1-4c56-87a2-140b92eb2e72 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Calling method '.version_select at 0x7f7cd487b5b0>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:35 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-6922a4db-d2e1-4c56-87a2-140b92eb2e72 tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-803644994" status: 204 len: 0 microversion: 2.42 time: 0.025368 Apr 12 00:33:35 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 92/275] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 12 00:33:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-803644994 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 00:33:38 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-a4630218-290b-4ec3-9a27-93ca558d0ca3 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:38 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-a4630218-290b-4ec3-9a27-93ca558d0ca3 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:38 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a4630218-290b-4ec3-9a27-93ca558d0ca3 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:38 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a4630218-290b-4ec3-9a27-93ca558d0ca3 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:38 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a4630218-290b-4ec3-9a27-93ca558d0ca3 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:38 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a4630218-290b-4ec3-9a27-93ca558d0ca3 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:38 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a4630218-290b-4ec3-9a27-93ca558d0ca3 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:38 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a4630218-290b-4ec3-9a27-93ca558d0ca3 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:38 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-a4630218-290b-4ec3-9a27-93ca558d0ca3 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] HTTP exception thrown: Instance f784806a-987f-4861-a23a-dbf961c8b6c1 could not be found. Apr 12 00:33:38 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-a4630218-290b-4ec3-9a27-93ca558d0ca3 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Request method failure captured: Apr 12 00:33:38 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/f784806a-987f-4861-a23a-dbf961c8b6c1 HTTP/1.1 Apr 12 00:33:38 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:33:38 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:33:38 user devstack@n-api.service[72494]: Connection: close Apr 12 00:33:38 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:33:38 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:33:38 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:33:38 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:33:38 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:33:38 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNft7RvZy1y3idU3waWMWk9K8RvlmqHCheMcMnNZjs5YwpHWpzOqbp07fyrHL6UKE5dazAvkLdm2Hh_5HCIj3DllogzK35J32TANAkCIn_uU3Bx9Ig6OXzeubjxFp5dY6jQNlepBfmpsUcv7bC0oujRtFhBvUN6vMfWC7Go3UbPMmwu8 Apr 12 00:33:38 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:33:38 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:33:38 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:33:38 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:33:38 user devstack@n-api.service[72494]: X-Openstack-Nova-Api-Version: 2.32 Apr 12 00:33:38 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:33:38 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:33:38 user devstack@n-api.service[72494]: X-Project-Id: b6b2a25677e14a23ae7b81e2e56c008a Apr 12 00:33:38 user devstack@n-api.service[72494]: X-Project-Name: tempest-TaggedBootDevicesTest-801742631 Apr 12 00:33:38 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:33:38 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:33:38 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b6b2a25677e14a23ae7b81e2e56c008a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b6b2a25677e14a23ae7b81e2e56c008a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b6b2a25677e14a23ae7b81e2e56c008a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:33:38 user devstack@n-api.service[72494]: X-Tenant: tempest-TaggedBootDevicesTest-801742631 Apr 12 00:33:38 user devstack@n-api.service[72494]: X-Tenant-Id: b6b2a25677e14a23ae7b81e2e56c008a Apr 12 00:33:38 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-TaggedBootDevicesTest-801742631 Apr 12 00:33:38 user devstack@n-api.service[72494]: X-User: tempest-TaggedBootDevicesTest-801742631-project-member Apr 12 00:33:38 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:33:38 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:33:38 user devstack@n-api.service[72494]: X-User-Id: df6b3a1f732c47e1aaa08b26056695d3 Apr 12 00:33:38 user devstack@n-api.service[72494]: X-User-Name: tempest-TaggedBootDevicesTest-801742631-project-member Apr 12 00:33:38 user devstack@n-api.service[72494]: method: > Apr 12 00:33:38 user devstack@n-api.service[72494]: exception: Instance f784806a-987f-4861-a23a-dbf961c8b6c1 could not be found. Apr 12 00:33:38 user devstack@n-api.service[72494]: action_args: {'id': 'f784806a-987f-4861-a23a-dbf961c8b6c1'} Apr 12 00:33:38 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f784806a-987f-4861-a23a-dbf961c8b6c1 could not be found. Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f784806a-987f-4861-a23a-dbf961c8b6c1 could not be found. Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f784806a-987f-4861-a23a-dbf961c8b6c1 could not be found. Apr 12 00:33:38 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:33:38 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-a4630218-290b-4ec3-9a27-93ca558d0ca3 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Returning 404 to user: Instance f784806a-987f-4861-a23a-dbf961c8b6c1 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:33:38 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-a4630218-290b-4ec3-9a27-93ca558d0ca3 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f784806a-987f-4861-a23a-dbf961c8b6c1" status: 404 len: 111 microversion: 2.32 time: 0.027910 Apr 12 00:33:38 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 91/276] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:33:38 2023] GET /compute/v2.1/servers/f784806a-987f-4861-a23a-dbf961c8b6c1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:33:38 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-9d643246-6f6b-44bb-9833-f87898c20de9 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Calling method '.version_select at 0x7f7cd47cdcf0>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:38 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-9d643246-6f6b-44bb-9833-f87898c20de9 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2004337280" status: 204 len: 0 microversion: 2.32 time: 0.027630 Apr 12 00:33:38 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 94/277] 10.0.0.210 () {64 vars in 1339 bytes} [Wed Apr 12 00:33:38 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2004337280 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-e6b22866-ab30-4b6c-83a5-b74ca9b5043c tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-e6b22866-ab30-4b6c-83a5-b74ca9b5043c tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e6b22866-ab30-4b6c-83a5-b74ca9b5043c tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e6b22866-ab30-4b6c-83a5-b74ca9b5043c tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e6b22866-ab30-4b6c-83a5-b74ca9b5043c tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e6b22866-ab30-4b6c-83a5-b74ca9b5043c tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e6b22866-ab30-4b6c-83a5-b74ca9b5043c tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e6b22866-ab30-4b6c-83a5-b74ca9b5043c tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:39 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-e6b22866-ab30-4b6c-83a5-b74ca9b5043c tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] HTTP exception thrown: Instance e3b52368-86be-4211-a37b-522ed3991a00 could not be found. Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-e6b22866-ab30-4b6c-83a5-b74ca9b5043c tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Request method failure captured: Apr 12 00:33:39 user devstack@n-api.service[72495]: request: DELETE /compute/v2.1/servers/e3b52368-86be-4211-a37b-522ed3991a00 HTTP/1.1 Apr 12 00:33:39 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:33:39 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:33:39 user devstack@n-api.service[72495]: Connection: close Apr 12 00:33:39 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 00:33:39 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:33:39 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:33:39 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:33:39 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:33:39 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNft6CrpqaIjyISvOScQBb593z9lJN22U4zvqCVS59VNpsZzGuSh7aDN1HxE9m7hdNUViJ4kpBScBj-gCu1qE2UoIUJcEPxKxIwenUnE7I1ToJoYUyfLwIFYYOqZWF9Jhprg0nx70r97xAcx0JIF2gwdcXUZGgYP7QaaJrrUKWkD0zKY Apr 12 00:33:39 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:33:39 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:33:39 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:33:39 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:33:39 user devstack@n-api.service[72495]: X-Openstack-Nova-Api-Version: 2.42 Apr 12 00:33:39 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:33:39 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:33:39 user devstack@n-api.service[72495]: X-Project-Id: c45d99a301794a748dadf4c96860835c Apr 12 00:33:39 user devstack@n-api.service[72495]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2057856153 Apr 12 00:33:39 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:33:39 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:33:39 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c45d99a301794a748dadf4c96860835c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c45d99a301794a748dadf4c96860835c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c45d99a301794a748dadf4c96860835c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:33:39 user devstack@n-api.service[72495]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2057856153 Apr 12 00:33:39 user devstack@n-api.service[72495]: X-Tenant-Id: c45d99a301794a748dadf4c96860835c Apr 12 00:33:39 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2057856153 Apr 12 00:33:39 user devstack@n-api.service[72495]: X-User: tempest-TaggedBootDevicesTest_v242-2057856153-project-member Apr 12 00:33:39 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:33:39 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:33:39 user devstack@n-api.service[72495]: X-User-Id: 846fa2a73bbb4036ad3fb19afc811131 Apr 12 00:33:39 user devstack@n-api.service[72495]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2057856153-project-member Apr 12 00:33:39 user devstack@n-api.service[72495]: method: > Apr 12 00:33:39 user devstack@n-api.service[72495]: exception: Instance e3b52368-86be-4211-a37b-522ed3991a00 could not be found. Apr 12 00:33:39 user devstack@n-api.service[72495]: action_args: {'id': 'e3b52368-86be-4211-a37b-522ed3991a00'} Apr 12 00:33:39 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3b52368-86be-4211-a37b-522ed3991a00 could not be found. Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3b52368-86be-4211-a37b-522ed3991a00 could not be found. Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3b52368-86be-4211-a37b-522ed3991a00 could not be found. Apr 12 00:33:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-e6b22866-ab30-4b6c-83a5-b74ca9b5043c tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Returning 404 to user: Instance e3b52368-86be-4211-a37b-522ed3991a00 could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:33:39 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-e6b22866-ab30-4b6c-83a5-b74ca9b5043c tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e3b52368-86be-4211-a37b-522ed3991a00" status: 404 len: 111 microversion: 2.42 time: 0.034504 Apr 12 00:33:39 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 93/278] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 00:33:39 2023] DELETE /compute/v2.1/servers/e3b52368-86be-4211-a37b-522ed3991a00 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:33:39 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-301f82bc-e9ad-4298-90f8-89e03e37bead tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:39 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-301f82bc-e9ad-4298-90f8-89e03e37bead tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] [instance: e3b52368-86be-4211-a37b-522ed3991a00] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-301f82bc-e9ad-4298-90f8-89e03e37bead tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-301f82bc-e9ad-4298-90f8-89e03e37bead tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-301f82bc-e9ad-4298-90f8-89e03e37bead tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-301f82bc-e9ad-4298-90f8-89e03e37bead tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-301f82bc-e9ad-4298-90f8-89e03e37bead tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-301f82bc-e9ad-4298-90f8-89e03e37bead tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:39 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-301f82bc-e9ad-4298-90f8-89e03e37bead tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] HTTP exception thrown: Instance e3b52368-86be-4211-a37b-522ed3991a00 could not be found. Apr 12 00:33:39 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-301f82bc-e9ad-4298-90f8-89e03e37bead tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Request method failure captured: Apr 12 00:33:39 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/e3b52368-86be-4211-a37b-522ed3991a00 HTTP/1.1 Apr 12 00:33:39 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:33:39 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:33:39 user devstack@n-api.service[72494]: Connection: close Apr 12 00:33:39 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:33:39 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:33:39 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:33:39 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:33:39 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:33:39 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNft6CrpqaIjyISvOScQBb593z9lJN22U4zvqCVS59VNpsZzGuSh7aDN1HxE9m7hdNUViJ4kpBScBj-gCu1qE2UoIUJcEPxKxIwenUnE7I1ToJoYUyfLwIFYYOqZWF9Jhprg0nx70r97xAcx0JIF2gwdcXUZGgYP7QaaJrrUKWkD0zKY Apr 12 00:33:39 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:33:39 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:33:39 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:33:39 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:33:39 user devstack@n-api.service[72494]: X-Openstack-Nova-Api-Version: 2.42 Apr 12 00:33:39 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:33:39 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:33:39 user devstack@n-api.service[72494]: X-Project-Id: c45d99a301794a748dadf4c96860835c Apr 12 00:33:39 user devstack@n-api.service[72494]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2057856153 Apr 12 00:33:39 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:33:39 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:33:39 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c45d99a301794a748dadf4c96860835c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c45d99a301794a748dadf4c96860835c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c45d99a301794a748dadf4c96860835c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:33:39 user devstack@n-api.service[72494]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2057856153 Apr 12 00:33:39 user devstack@n-api.service[72494]: X-Tenant-Id: c45d99a301794a748dadf4c96860835c Apr 12 00:33:39 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2057856153 Apr 12 00:33:39 user devstack@n-api.service[72494]: X-User: tempest-TaggedBootDevicesTest_v242-2057856153-project-member Apr 12 00:33:39 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:33:39 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:33:39 user devstack@n-api.service[72494]: X-User-Id: 846fa2a73bbb4036ad3fb19afc811131 Apr 12 00:33:39 user devstack@n-api.service[72494]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2057856153-project-member Apr 12 00:33:39 user devstack@n-api.service[72494]: method: > Apr 12 00:33:39 user devstack@n-api.service[72494]: exception: Instance e3b52368-86be-4211-a37b-522ed3991a00 could not be found. Apr 12 00:33:39 user devstack@n-api.service[72494]: action_args: {'id': 'e3b52368-86be-4211-a37b-522ed3991a00'} Apr 12 00:33:39 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3b52368-86be-4211-a37b-522ed3991a00 could not be found. Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3b52368-86be-4211-a37b-522ed3991a00 could not be found. Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3b52368-86be-4211-a37b-522ed3991a00 could not be found. Apr 12 00:33:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-301f82bc-e9ad-4298-90f8-89e03e37bead tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] Returning 404 to user: Instance e3b52368-86be-4211-a37b-522ed3991a00 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:33:39 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-301f82bc-e9ad-4298-90f8-89e03e37bead tempest-TaggedBootDevicesTest_v242-2057856153 tempest-TaggedBootDevicesTest_v242-2057856153-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3b52368-86be-4211-a37b-522ed3991a00" status: 404 len: 111 microversion: 2.42 time: 0.028626 Apr 12 00:33:39 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 92/279] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:33:39 2023] GET /compute/v2.1/servers/e3b52368-86be-4211-a37b-522ed3991a00 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-64949a89-a23f-4afc-b8f2-cc733e07af46 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-64949a89-a23f-4afc-b8f2-cc733e07af46 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-64949a89-a23f-4afc-b8f2-cc733e07af46 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-64949a89-a23f-4afc-b8f2-cc733e07af46 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-64949a89-a23f-4afc-b8f2-cc733e07af46 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-64949a89-a23f-4afc-b8f2-cc733e07af46 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-64949a89-a23f-4afc-b8f2-cc733e07af46 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-64949a89-a23f-4afc-b8f2-cc733e07af46 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:39 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-64949a89-a23f-4afc-b8f2-cc733e07af46 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052366 Apr 12 00:33:39 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 95/280] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:33:39 2023] GET /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-5fc7dfbf-3c1b-4631-b970-8e1d006fd7dc tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-5fc7dfbf-3c1b-4631-b970-8e1d006fd7dc tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-5fc7dfbf-3c1b-4631-b970-8e1d006fd7dc tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-5fc7dfbf-3c1b-4631-b970-8e1d006fd7dc tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-5fc7dfbf-3c1b-4631-b970-8e1d006fd7dc tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-5fc7dfbf-3c1b-4631-b970-8e1d006fd7dc tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-5fc7dfbf-3c1b-4631-b970-8e1d006fd7dc tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-5fc7dfbf-3c1b-4631-b970-8e1d006fd7dc tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Going to try to terminate instance {{(pid=72495) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:33:39 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-5fc7dfbf-3c1b-4631-b970-8e1d006fd7dc tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] HTTP exception thrown: Instance 7f1f85bf-03e5-493e-b187-955998b020ee could not be found. Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-5fc7dfbf-3c1b-4631-b970-8e1d006fd7dc tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Request method failure captured: Apr 12 00:33:39 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/7f1f85bf-03e5-493e-b187-955998b020ee HTTP/1.1 Apr 12 00:33:39 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:33:39 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:33:39 user devstack@n-api.service[72496]: Connection: close Apr 12 00:33:39 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:33:39 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:33:39 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:33:39 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:33:39 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNfut1jPVwgpnHF2p4IDb8mw8QCnmrhPi1bglXERi9o-oc8KfA86Nj8qbMXqGPJ-Qu-hg1buox-hKkUkiuJLGP2TjR-hKqepkY3sMZyNoxK3mS9Lgsu4E_4fnuzEqTUjrpCZSmbPFt9R2omKh-uhIkWfp0X1fr8C_wHlflXHVBJsAvYQ Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Project-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Project-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Tenant: tempest-TestVolumeBootPattern-726466832 Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Tenant-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:33:39 user devstack@n-api.service[72496]: X-User: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:33:39 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:33:39 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:33:39 user devstack@n-api.service[72496]: X-User-Id: c479f6ae2f0d40908be9b07717ca3509 Apr 12 00:33:39 user devstack@n-api.service[72496]: X-User-Name: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:33:39 user devstack@n-api.service[72496]: method: > Apr 12 00:33:39 user devstack@n-api.service[72496]: exception: Instance 7f1f85bf-03e5-493e-b187-955998b020ee could not be found. Apr 12 00:33:39 user devstack@n-api.service[72496]: action_args: {'id': '7f1f85bf-03e5-493e-b187-955998b020ee'} Apr 12 00:33:39 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f1f85bf-03e5-493e-b187-955998b020ee could not be found. Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f1f85bf-03e5-493e-b187-955998b020ee could not be found. Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f1f85bf-03e5-493e-b187-955998b020ee could not be found. Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-5fc7dfbf-3c1b-4631-b970-8e1d006fd7dc tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Returning 404 to user: Instance 7f1f85bf-03e5-493e-b187-955998b020ee could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:33:39 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-5fc7dfbf-3c1b-4631-b970-8e1d006fd7dc tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f1f85bf-03e5-493e-b187-955998b020ee" status: 404 len: 111 microversion: 2.1 time: 0.047008 Apr 12 00:33:39 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 96/281] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:33:39 2023] GET /compute/v2.1/servers/7f1f85bf-03e5-493e-b187-955998b020ee => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-1794089e-d9b6-4be3-911a-730a4846dab3 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-1794089e-d9b6-4be3-911a-730a4846dab3 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1794089e-d9b6-4be3-911a-730a4846dab3 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1794089e-d9b6-4be3-911a-730a4846dab3 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1794089e-d9b6-4be3-911a-730a4846dab3 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1794089e-d9b6-4be3-911a-730a4846dab3 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1794089e-d9b6-4be3-911a-730a4846dab3 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1794089e-d9b6-4be3-911a-730a4846dab3 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:39 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-1794089e-d9b6-4be3-911a-730a4846dab3 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] HTTP exception thrown: Instance 7f1f85bf-03e5-493e-b187-955998b020ee could not be found. Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-1794089e-d9b6-4be3-911a-730a4846dab3 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Request method failure captured: Apr 12 00:33:39 user devstack@n-api.service[72496]: request: DELETE /compute/v2.1/servers/7f1f85bf-03e5-493e-b187-955998b020ee HTTP/1.1 Apr 12 00:33:39 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:33:39 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:33:39 user devstack@n-api.service[72496]: Connection: close Apr 12 00:33:39 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:33:39 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:33:39 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:33:39 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:33:39 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNfut1jPVwgpnHF2p4IDb8mw8QCnmrhPi1bglXERi9o-oc8KfA86Nj8qbMXqGPJ-Qu-hg1buox-hKkUkiuJLGP2TjR-hKqepkY3sMZyNoxK3mS9Lgsu4E_4fnuzEqTUjrpCZSmbPFt9R2omKh-uhIkWfp0X1fr8C_wHlflXHVBJsAvYQ Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Project-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Project-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Tenant: tempest-TestVolumeBootPattern-726466832 Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Tenant-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:33:39 user devstack@n-api.service[72496]: X-User: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:33:39 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:33:39 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:33:39 user devstack@n-api.service[72496]: X-User-Id: c479f6ae2f0d40908be9b07717ca3509 Apr 12 00:33:39 user devstack@n-api.service[72496]: X-User-Name: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:33:39 user devstack@n-api.service[72496]: method: > Apr 12 00:33:39 user devstack@n-api.service[72496]: exception: Instance 7f1f85bf-03e5-493e-b187-955998b020ee could not be found. Apr 12 00:33:39 user devstack@n-api.service[72496]: action_args: {'id': '7f1f85bf-03e5-493e-b187-955998b020ee'} Apr 12 00:33:39 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f1f85bf-03e5-493e-b187-955998b020ee could not be found. Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f1f85bf-03e5-493e-b187-955998b020ee could not be found. Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f1f85bf-03e5-493e-b187-955998b020ee could not be found. Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-1794089e-d9b6-4be3-911a-730a4846dab3 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Returning 404 to user: Instance 7f1f85bf-03e5-493e-b187-955998b020ee could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:33:39 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-1794089e-d9b6-4be3-911a-730a4846dab3 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7f1f85bf-03e5-493e-b187-955998b020ee" status: 404 len: 111 microversion: 2.1 time: 0.033622 Apr 12 00:33:39 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 97/282] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:33:39 2023] DELETE /compute/v2.1/servers/7f1f85bf-03e5-493e-b187-955998b020ee => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-3b798678-5b40-4ccc-82ca-ac5fb42a6912 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-3b798678-5b40-4ccc-82ca-ac5fb42a6912 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 7f1f85bf-03e5-493e-b187-955998b020ee] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:39 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-abdc787b-9ec3-4dfc-af0e-cc8ade2d9353 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47" status: 204 len: 0 microversion: 2.1 time: 0.147362 Apr 12 00:33:39 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 94/283] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:33:39 2023] DELETE /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-3b798678-5b40-4ccc-82ca-ac5fb42a6912 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-3b798678-5b40-4ccc-82ca-ac5fb42a6912 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-3b798678-5b40-4ccc-82ca-ac5fb42a6912 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-3b798678-5b40-4ccc-82ca-ac5fb42a6912 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-3b798678-5b40-4ccc-82ca-ac5fb42a6912 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-3b798678-5b40-4ccc-82ca-ac5fb42a6912 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-b840922d-9b88-497d-8761-78fe54145671 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-b840922d-9b88-497d-8761-78fe54145671 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b840922d-9b88-497d-8761-78fe54145671 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b840922d-9b88-497d-8761-78fe54145671 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b840922d-9b88-497d-8761-78fe54145671 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b840922d-9b88-497d-8761-78fe54145671 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b840922d-9b88-497d-8761-78fe54145671 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b840922d-9b88-497d-8761-78fe54145671 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:39 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-3b798678-5b40-4ccc-82ca-ac5fb42a6912 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] HTTP exception thrown: Instance 7f1f85bf-03e5-493e-b187-955998b020ee could not be found. Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-3b798678-5b40-4ccc-82ca-ac5fb42a6912 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Request method failure captured: Apr 12 00:33:39 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/7f1f85bf-03e5-493e-b187-955998b020ee HTTP/1.1 Apr 12 00:33:39 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:33:39 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:33:39 user devstack@n-api.service[72496]: Connection: close Apr 12 00:33:39 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:33:39 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:33:39 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:33:39 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:33:39 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNfut1jPVwgpnHF2p4IDb8mw8QCnmrhPi1bglXERi9o-oc8KfA86Nj8qbMXqGPJ-Qu-hg1buox-hKkUkiuJLGP2TjR-hKqepkY3sMZyNoxK3mS9Lgsu4E_4fnuzEqTUjrpCZSmbPFt9R2omKh-uhIkWfp0X1fr8C_wHlflXHVBJsAvYQ Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Project-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Project-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Tenant: tempest-TestVolumeBootPattern-726466832 Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Tenant-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:33:39 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:33:39 user devstack@n-api.service[72496]: X-User: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:33:39 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:33:39 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:33:39 user devstack@n-api.service[72496]: X-User-Id: c479f6ae2f0d40908be9b07717ca3509 Apr 12 00:33:39 user devstack@n-api.service[72496]: X-User-Name: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:33:39 user devstack@n-api.service[72496]: method: > Apr 12 00:33:39 user devstack@n-api.service[72496]: exception: Instance 7f1f85bf-03e5-493e-b187-955998b020ee could not be found. Apr 12 00:33:39 user devstack@n-api.service[72496]: action_args: {'id': '7f1f85bf-03e5-493e-b187-955998b020ee'} Apr 12 00:33:39 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f1f85bf-03e5-493e-b187-955998b020ee could not be found. Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f1f85bf-03e5-493e-b187-955998b020ee could not be found. Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f1f85bf-03e5-493e-b187-955998b020ee could not be found. Apr 12 00:33:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:39 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-3b798678-5b40-4ccc-82ca-ac5fb42a6912 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Returning 404 to user: Instance 7f1f85bf-03e5-493e-b187-955998b020ee could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:33:39 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-3b798678-5b40-4ccc-82ca-ac5fb42a6912 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f1f85bf-03e5-493e-b187-955998b020ee" status: 404 len: 111 microversion: 2.1 time: 0.053887 Apr 12 00:33:39 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 98/284] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:33:39 2023] GET /compute/v2.1/servers/7f1f85bf-03e5-493e-b187-955998b020ee => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 00:33:40 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1962160944", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "networks": [{"uuid": "2e59f1f4-986f-4135-b7f2-1d333d3017ad"}]}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:40 user devstack@n-api.service[72494]: DEBUG nova.network.neutron [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] validate_networks() for [('2e59f1f4-986f-4135-b7f2-1d333d3017ad', None, None, None, None, None)] {{(pid=72494) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:33:40 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-c355e266-dda2-42c2-b519-e4eff3e21b58 req-95d39cd1-a90c-41b8-b261-ebf5e2c8126b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be536dd-61f5-4a17-a734-029b25739a47", "name": "network-vif-unplugged", "status": "completed", "tag": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-c355e266-dda2-42c2-b519-e4eff3e21b58 req-95d39cd1-a90c-41b8-b261-ebf5e2c8126b service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-c355e266-dda2-42c2-b519-e4eff3e21b58 req-95d39cd1-a90c-41b8-b261-ebf5e2c8126b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-c355e266-dda2-42c2-b519-e4eff3e21b58 req-95d39cd1-a90c-41b8-b261-ebf5e2c8126b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:40 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-c355e266-dda2-42c2-b519-e4eff3e21b58 req-95d39cd1-a90c-41b8-b261-ebf5e2c8126b service nova] Creating event network-vif-unplugged:bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 for instance 5be536dd-61f5-4a17-a734-029b25739a47 on user Apr 12 00:33:40 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-c355e266-dda2-42c2-b519-e4eff3e21b58 req-95d39cd1-a90c-41b8-b261-ebf5e2c8126b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033168 Apr 12 00:33:40 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 99/285] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:33:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:40 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-b840922d-9b88-497d-8761-78fe54145671 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4edaa34382341fd8f99f9d0921d80b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff88f0df3414610858ecf3d60295c26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:33:40 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-b840922d-9b88-497d-8761-78fe54145671 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47" status: 200 len: 1647 microversion: 2.1 time: 0.309739 Apr 12 00:33:40 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 95/286] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:33:39 2023] GET /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47 => generated 1647 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:40 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Flavor limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:33:40 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Image limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:33:40 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Flavor pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:33:40 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Image pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:33:40 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:33:40 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:40 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:40 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:40 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:40 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:40 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:40 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Getting quotas for project f4a7eb4a2a09418eacdeaccefbf7de15. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:33:40 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Getting quotas for user 69d6e340820641729772cf35648ef785 and project f4a7eb4a2a09418eacdeaccefbf7de15. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:33:40 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Going to run 1 instances... {{(pid=72494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:33:40 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:33:40 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-22a483be-72d0-42ac-8ddf-85d72ad54698 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.172249 Apr 12 00:33:40 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 93/287] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 00:33:39 2023] POST /compute/v2.1/servers => generated 378 bytes in 1174 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 00:33:40 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-0c7e270e-0c99-4631-a21a-372dcf0d55fc tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:41 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-0c7e270e-0c99-4631-a21a-372dcf0d55fc tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:41 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-0c7e270e-0c99-4631-a21a-372dcf0d55fc tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:33:41 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-0c7e270e-0c99-4631-a21a-372dcf0d55fc tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:33:41 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-0c7e270e-0c99-4631-a21a-372dcf0d55fc tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:33:41 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-0c7e270e-0c99-4631-a21a-372dcf0d55fc tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" status: 200 len: 1395 microversion: 2.87 time: 0.109151 Apr 12 00:33:41 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 100/288] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:33:40 2023] GET /compute/v2.1/servers/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 => generated 1395 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:33:41 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-1d99a747-a734-485c-b2b8-b8d65b0efcda req-ae846ddd-b06f-4829-b3d4-c465df6674d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be536dd-61f5-4a17-a734-029b25739a47", "name": "network-vif-deleted", "tag": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:41 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-1d99a747-a734-485c-b2b8-b8d65b0efcda req-ae846ddd-b06f-4829-b3d4-c465df6674d0 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:41 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-1d99a747-a734-485c-b2b8-b8d65b0efcda req-ae846ddd-b06f-4829-b3d4-c465df6674d0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:41 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-1d99a747-a734-485c-b2b8-b8d65b0efcda req-ae846ddd-b06f-4829-b3d4-c465df6674d0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:41 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-1d99a747-a734-485c-b2b8-b8d65b0efcda req-ae846ddd-b06f-4829-b3d4-c465df6674d0 service nova] Creating event network-vif-deleted:bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 for instance 5be536dd-61f5-4a17-a734-029b25739a47 on user Apr 12 00:33:41 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-1d99a747-a734-485c-b2b8-b8d65b0efcda req-ae846ddd-b06f-4829-b3d4-c465df6674d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054874 Apr 12 00:33:41 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 96/289] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:33:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:42 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-10f9a7d9-42a7-4dd7-aae1-5e2a4fd9412f req-35a8fb21-881c-468a-9f94-6086761390fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be536dd-61f5-4a17-a734-029b25739a47", "name": "network-vif-plugged", "status": "completed", "tag": "bb2a7afd-3e9c-4291-82ff-c443bee5c1f9"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-10f9a7d9-42a7-4dd7-aae1-5e2a4fd9412f req-35a8fb21-881c-468a-9f94-6086761390fb service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-10f9a7d9-42a7-4dd7-aae1-5e2a4fd9412f req-35a8fb21-881c-468a-9f94-6086761390fb service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-10f9a7d9-42a7-4dd7-aae1-5e2a4fd9412f req-35a8fb21-881c-468a-9f94-6086761390fb service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:42 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-10f9a7d9-42a7-4dd7-aae1-5e2a4fd9412f req-35a8fb21-881c-468a-9f94-6086761390fb service nova] Creating event network-vif-plugged:bb2a7afd-3e9c-4291-82ff-c443bee5c1f9 for instance 5be536dd-61f5-4a17-a734-029b25739a47 on user Apr 12 00:33:42 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-10f9a7d9-42a7-4dd7-aae1-5e2a4fd9412f req-35a8fb21-881c-468a-9f94-6086761390fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039396 Apr 12 00:33:42 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 94/290] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:33:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:42 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-bcc3891a-668f-4adc-b5d9-d73ca0711e92 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:42 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-bcc3891a-668f-4adc-b5d9-d73ca0711e92 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-bcc3891a-668f-4adc-b5d9-d73ca0711e92 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-bcc3891a-668f-4adc-b5d9-d73ca0711e92 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-bcc3891a-668f-4adc-b5d9-d73ca0711e92 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-bcc3891a-668f-4adc-b5d9-d73ca0711e92 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-bcc3891a-668f-4adc-b5d9-d73ca0711e92 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-bcc3891a-668f-4adc-b5d9-d73ca0711e92 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:42 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-bcc3891a-668f-4adc-b5d9-d73ca0711e92 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:33:42 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-bcc3891a-668f-4adc-b5d9-d73ca0711e92 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 200 len: 1658 microversion: 2.1 time: 0.304172 Apr 12 00:33:42 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 101/291] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:33:42 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 1658 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:42 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0edc110-1f0c-4311-b54d-6de6a1d1d8f2"}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:42 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:42 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:42 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:42 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:42 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:42 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:42 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:42 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-d709d6d0-82c4-4cd4-86e9-f9b3ddf70831 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:42 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-d709d6d0-82c4-4cd4-86e9-f9b3ddf70831 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d709d6d0-82c4-4cd4-86e9-f9b3ddf70831 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d709d6d0-82c4-4cd4-86e9-f9b3ddf70831 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d709d6d0-82c4-4cd4-86e9-f9b3ddf70831 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d709d6d0-82c4-4cd4-86e9-f9b3ddf70831 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d709d6d0-82c4-4cd4-86e9-f9b3ddf70831 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d709d6d0-82c4-4cd4-86e9-f9b3ddf70831 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:43 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-d709d6d0-82c4-4cd4-86e9-f9b3ddf70831 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] HTTP exception thrown: Instance f784806a-987f-4861-a23a-dbf961c8b6c1 could not be found. Apr 12 00:33:43 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-d709d6d0-82c4-4cd4-86e9-f9b3ddf70831 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Request method failure captured: Apr 12 00:33:43 user devstack@n-api.service[72494]: request: DELETE /compute/v2.1/servers/f784806a-987f-4861-a23a-dbf961c8b6c1 HTTP/1.1 Apr 12 00:33:43 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:33:43 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:33:43 user devstack@n-api.service[72494]: Connection: close Apr 12 00:33:43 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:33:43 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:33:43 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:33:43 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:33:43 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:33:43 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNft7RvZy1y3idU3waWMWk9K8RvlmqHCheMcMnNZjs5YwpHWpzOqbp07fyrHL6UKE5dazAvkLdm2Hh_5HCIj3DllogzK35J32TANAkCIn_uU3Bx9Ig6OXzeubjxFp5dY6jQNlepBfmpsUcv7bC0oujRtFhBvUN6vMfWC7Go3UbPMmwu8 Apr 12 00:33:43 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:33:43 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:33:43 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:33:43 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:33:43 user devstack@n-api.service[72494]: X-Openstack-Nova-Api-Version: 2.32 Apr 12 00:33:43 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:33:43 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:33:43 user devstack@n-api.service[72494]: X-Project-Id: b6b2a25677e14a23ae7b81e2e56c008a Apr 12 00:33:43 user devstack@n-api.service[72494]: X-Project-Name: tempest-TaggedBootDevicesTest-801742631 Apr 12 00:33:43 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:33:43 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:33:43 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b6b2a25677e14a23ae7b81e2e56c008a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b6b2a25677e14a23ae7b81e2e56c008a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b6b2a25677e14a23ae7b81e2e56c008a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:33:43 user devstack@n-api.service[72494]: X-Tenant: tempest-TaggedBootDevicesTest-801742631 Apr 12 00:33:43 user devstack@n-api.service[72494]: X-Tenant-Id: b6b2a25677e14a23ae7b81e2e56c008a Apr 12 00:33:43 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-TaggedBootDevicesTest-801742631 Apr 12 00:33:43 user devstack@n-api.service[72494]: X-User: tempest-TaggedBootDevicesTest-801742631-project-member Apr 12 00:33:43 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:33:43 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:33:43 user devstack@n-api.service[72494]: X-User-Id: df6b3a1f732c47e1aaa08b26056695d3 Apr 12 00:33:43 user devstack@n-api.service[72494]: X-User-Name: tempest-TaggedBootDevicesTest-801742631-project-member Apr 12 00:33:43 user devstack@n-api.service[72494]: method: > Apr 12 00:33:43 user devstack@n-api.service[72494]: exception: Instance f784806a-987f-4861-a23a-dbf961c8b6c1 could not be found. Apr 12 00:33:43 user devstack@n-api.service[72494]: action_args: {'id': 'f784806a-987f-4861-a23a-dbf961c8b6c1'} Apr 12 00:33:43 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f784806a-987f-4861-a23a-dbf961c8b6c1 could not be found. Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f784806a-987f-4861-a23a-dbf961c8b6c1 could not be found. Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f784806a-987f-4861-a23a-dbf961c8b6c1 could not be found. Apr 12 00:33:43 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:33:43 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-d709d6d0-82c4-4cd4-86e9-f9b3ddf70831 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Returning 404 to user: Instance f784806a-987f-4861-a23a-dbf961c8b6c1 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:33:43 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-d709d6d0-82c4-4cd4-86e9-f9b3ddf70831 tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f784806a-987f-4861-a23a-dbf961c8b6c1" status: 404 len: 111 microversion: 2.32 time: 0.054478 Apr 12 00:33:43 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 95/292] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 00:33:42 2023] DELETE /compute/v2.1/servers/f784806a-987f-4861-a23a-dbf961c8b6c1 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:33:43 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-d2dbad94-39c5-4747-af42-b67e53ebe3fe tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:43 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-d2dbad94-39c5-4747-af42-b67e53ebe3fe tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] [instance: f784806a-987f-4861-a23a-dbf961c8b6c1] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d2dbad94-39c5-4747-af42-b67e53ebe3fe tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d2dbad94-39c5-4747-af42-b67e53ebe3fe tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d2dbad94-39c5-4747-af42-b67e53ebe3fe tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d2dbad94-39c5-4747-af42-b67e53ebe3fe tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d2dbad94-39c5-4747-af42-b67e53ebe3fe tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d2dbad94-39c5-4747-af42-b67e53ebe3fe tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:43 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-d2dbad94-39c5-4747-af42-b67e53ebe3fe tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] HTTP exception thrown: Instance f784806a-987f-4861-a23a-dbf961c8b6c1 could not be found. Apr 12 00:33:43 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-d2dbad94-39c5-4747-af42-b67e53ebe3fe tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Request method failure captured: Apr 12 00:33:43 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/f784806a-987f-4861-a23a-dbf961c8b6c1 HTTP/1.1 Apr 12 00:33:43 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:33:43 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:33:43 user devstack@n-api.service[72496]: Connection: close Apr 12 00:33:43 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:33:43 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:33:43 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:33:43 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:33:43 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:33:43 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNft7RvZy1y3idU3waWMWk9K8RvlmqHCheMcMnNZjs5YwpHWpzOqbp07fyrHL6UKE5dazAvkLdm2Hh_5HCIj3DllogzK35J32TANAkCIn_uU3Bx9Ig6OXzeubjxFp5dY6jQNlepBfmpsUcv7bC0oujRtFhBvUN6vMfWC7Go3UbPMmwu8 Apr 12 00:33:43 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:33:43 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:33:43 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:33:43 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:33:43 user devstack@n-api.service[72496]: X-Openstack-Nova-Api-Version: 2.32 Apr 12 00:33:43 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:33:43 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:33:43 user devstack@n-api.service[72496]: X-Project-Id: b6b2a25677e14a23ae7b81e2e56c008a Apr 12 00:33:43 user devstack@n-api.service[72496]: X-Project-Name: tempest-TaggedBootDevicesTest-801742631 Apr 12 00:33:43 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:33:43 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:33:43 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b6b2a25677e14a23ae7b81e2e56c008a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b6b2a25677e14a23ae7b81e2e56c008a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b6b2a25677e14a23ae7b81e2e56c008a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:33:43 user devstack@n-api.service[72496]: X-Tenant: tempest-TaggedBootDevicesTest-801742631 Apr 12 00:33:43 user devstack@n-api.service[72496]: X-Tenant-Id: b6b2a25677e14a23ae7b81e2e56c008a Apr 12 00:33:43 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-TaggedBootDevicesTest-801742631 Apr 12 00:33:43 user devstack@n-api.service[72496]: X-User: tempest-TaggedBootDevicesTest-801742631-project-member Apr 12 00:33:43 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:33:43 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:33:43 user devstack@n-api.service[72496]: X-User-Id: df6b3a1f732c47e1aaa08b26056695d3 Apr 12 00:33:43 user devstack@n-api.service[72496]: X-User-Name: tempest-TaggedBootDevicesTest-801742631-project-member Apr 12 00:33:43 user devstack@n-api.service[72496]: method: > Apr 12 00:33:43 user devstack@n-api.service[72496]: exception: Instance f784806a-987f-4861-a23a-dbf961c8b6c1 could not be found. Apr 12 00:33:43 user devstack@n-api.service[72496]: action_args: {'id': 'f784806a-987f-4861-a23a-dbf961c8b6c1'} Apr 12 00:33:43 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f784806a-987f-4861-a23a-dbf961c8b6c1 could not be found. Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f784806a-987f-4861-a23a-dbf961c8b6c1 could not be found. Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f784806a-987f-4861-a23a-dbf961c8b6c1 could not be found. Apr 12 00:33:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:33:43 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-d2dbad94-39c5-4747-af42-b67e53ebe3fe tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] Returning 404 to user: Instance f784806a-987f-4861-a23a-dbf961c8b6c1 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:33:43 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-d2dbad94-39c5-4747-af42-b67e53ebe3fe tempest-TaggedBootDevicesTest-801742631 tempest-TaggedBootDevicesTest-801742631-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f784806a-987f-4861-a23a-dbf961c8b6c1" status: 404 len: 111 microversion: 2.32 time: 0.034097 Apr 12 00:33:43 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 102/293] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:33:43 2023] GET /compute/v2.1/servers/f784806a-987f-4861-a23a-dbf961c8b6c1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 12 00:33:43 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-878d2cde-22b7-4e11-afa5-a8f7438cb1c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.364505 Apr 12 00:33:43 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 97/294] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 00:33:42 2023] POST /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/os-volume_attachments => generated 194 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:43 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-72c7f1dd-4a46-452f-bd61-97b5d489e11b req-f70c65d9-3caa-4110-836b-1d11ddd3e1f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88", "tag": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-72c7f1dd-4a46-452f-bd61-97b5d489e11b req-f70c65d9-3caa-4110-836b-1d11ddd3e1f9 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-72c7f1dd-4a46-452f-bd61-97b5d489e11b req-f70c65d9-3caa-4110-836b-1d11ddd3e1f9 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-72c7f1dd-4a46-452f-bd61-97b5d489e11b req-f70c65d9-3caa-4110-836b-1d11ddd3e1f9 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:43 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-72c7f1dd-4a46-452f-bd61-97b5d489e11b req-f70c65d9-3caa-4110-836b-1d11ddd3e1f9 service nova] Creating event network-changed:203d6c33-a06b-4c9a-88e9-dbd8e823a6e5 for instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 on user Apr 12 00:33:43 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-72c7f1dd-4a46-452f-bd61-97b5d489e11b req-f70c65d9-3caa-4110-836b-1d11ddd3e1f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029703 Apr 12 00:33:43 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 96/295] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:33:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:46 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-7b56757d-bc32-462e-9808-bedfcaa6d9b8 req-53d6055d-c52d-4156-a566-4573d84ae9a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88", "name": "network-vif-plugged", "status": "completed", "tag": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:46 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-7b56757d-bc32-462e-9808-bedfcaa6d9b8 req-53d6055d-c52d-4156-a566-4573d84ae9a4 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:46 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-7b56757d-bc32-462e-9808-bedfcaa6d9b8 req-53d6055d-c52d-4156-a566-4573d84ae9a4 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:46 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-7b56757d-bc32-462e-9808-bedfcaa6d9b8 req-53d6055d-c52d-4156-a566-4573d84ae9a4 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:46 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-7b56757d-bc32-462e-9808-bedfcaa6d9b8 req-53d6055d-c52d-4156-a566-4573d84ae9a4 service nova] Creating event network-vif-plugged:203d6c33-a06b-4c9a-88e9-dbd8e823a6e5 for instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 on user Apr 12 00:33:46 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-7b56757d-bc32-462e-9808-bedfcaa6d9b8 req-53d6055d-c52d-4156-a566-4573d84ae9a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034246 Apr 12 00:33:46 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 103/296] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:33:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:48 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-836c5833-54be-4ad4-a78c-90b3cbc0776f req-7cd38864-8074-4b21-a7a5-fd6d6198218d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88", "name": "network-vif-plugged", "status": "completed", "tag": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:48 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-836c5833-54be-4ad4-a78c-90b3cbc0776f req-7cd38864-8074-4b21-a7a5-fd6d6198218d service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:48 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-836c5833-54be-4ad4-a78c-90b3cbc0776f req-7cd38864-8074-4b21-a7a5-fd6d6198218d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:48 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-836c5833-54be-4ad4-a78c-90b3cbc0776f req-7cd38864-8074-4b21-a7a5-fd6d6198218d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:48 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-836c5833-54be-4ad4-a78c-90b3cbc0776f req-7cd38864-8074-4b21-a7a5-fd6d6198218d service nova] Creating event network-vif-plugged:203d6c33-a06b-4c9a-88e9-dbd8e823a6e5 for instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 on user Apr 12 00:33:48 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-836c5833-54be-4ad4-a78c-90b3cbc0776f req-7cd38864-8074-4b21-a7a5-fd6d6198218d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038822 Apr 12 00:33:48 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 98/297] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:33:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:49 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-84409472", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "ca06330d-06f4-4f25-8449-2e03b021dc3b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "159bca51-de37-4d87-9af5-ec97816a869c"}]}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:49 user devstack@n-api.service[72494]: DEBUG nova.network.neutron [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] validate_networks() for [('159bca51-de37-4d87-9af5-ec97816a869c', None, None, None, None, None)] {{(pid=72494) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:33:50 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flavor limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:33:50 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Image limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:33:50 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flavor pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:33:50 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Image pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:33:50 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:33:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:50 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting quotas for project e38a98bf1d964ee6bd2d0d05e97a283a. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:33:50 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting quotas for user c479f6ae2f0d40908be9b07717ca3509 and project e38a98bf1d964ee6bd2d0d05e97a283a. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:33:50 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Going to run 1 instances... {{(pid=72494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:33:50 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca06330d-06f4-4f25-8449-2e03b021dc3b',volume_size=None,volume_type=None)] {{(pid=72494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:33:50 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:33:50 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-051a2c9e-4beb-4dcf-a574-d137771cc2c0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.055938 Apr 12 00:33:50 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 97/298] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:33:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:33:50 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-0f9c8a17-8b27-42ae-9510-874cd4c600f4 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:50 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-0f9c8a17-8b27-42ae-9510-874cd4c600f4 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:50 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:33:50 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-0f9c8a17-8b27-42ae-9510-874cd4c600f4 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:33:50 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-0f9c8a17-8b27-42ae-9510-874cd4c600f4 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8833bad-d30f-4cd4-aa66-10d60c782061" status: 200 len: 1064 microversion: 2.1 time: 0.081108 Apr 12 00:33:50 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 104/299] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:33:50 2023] GET /compute/v2.1/servers/d8833bad-d30f-4cd4-aa66-10d60c782061 => generated 1064 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:52 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-0e10a5c2-691d-4479-a700-76f0a6743db6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:52 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-0e10a5c2-691d-4479-a700-76f0a6743db6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:52 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:33:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-0e10a5c2-691d-4479-a700-76f0a6743db6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-0e10a5c2-691d-4479-a700-76f0a6743db6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-0e10a5c2-691d-4479-a700-76f0a6743db6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-0e10a5c2-691d-4479-a700-76f0a6743db6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-0e10a5c2-691d-4479-a700-76f0a6743db6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-0e10a5c2-691d-4479-a700-76f0a6743db6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:52 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:33:52 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-0e10a5c2-691d-4479-a700-76f0a6743db6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:33:52 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-0e10a5c2-691d-4479-a700-76f0a6743db6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 200 len: 1704 microversion: 2.1 time: 0.225090 Apr 12 00:33:52 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 99/300] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:33:51 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 1704 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:52 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-197146176", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:52 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:52 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:33:52 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting quotas for project d8ba626fdf264b879099a89097845153. Resources: dict_keys(['metadata_items']) {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:33:52 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting quotas for user d658147b4def4d12a16381d4c19357e3 and project d8ba626fdf264b879099a89097845153. Resources: dict_keys(['metadata_items']) {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:33:52 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:33:52 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:33:52 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:33:52 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:33:52 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:33:52 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:52 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-ead827c8-0cf1-4760-a077-829d26b3305c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/action" status: 202 len: 1158 microversion: 2.1 time: 0.515815 Apr 12 00:33:52 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 98/301] 10.0.0.210 () {64 vars in 1356 bytes} [Wed Apr 12 00:33:52 2023] POST /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/action => generated 1158 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 00:33:52 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-c1ae0362-8875-4b43-8b2a-2d659070db71 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:52 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-c1ae0362-8875-4b43-8b2a-2d659070db71 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:52 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c1ae0362-8875-4b43-8b2a-2d659070db71 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:52 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c1ae0362-8875-4b43-8b2a-2d659070db71 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:52 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c1ae0362-8875-4b43-8b2a-2d659070db71 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:52 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c1ae0362-8875-4b43-8b2a-2d659070db71 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:52 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c1ae0362-8875-4b43-8b2a-2d659070db71 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:52 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c1ae0362-8875-4b43-8b2a-2d659070db71 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:52 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:33:53 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-c1ae0362-8875-4b43-8b2a-2d659070db71 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:33:53 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-c1ae0362-8875-4b43-8b2a-2d659070db71 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 200 len: 1731 microversion: 2.1 time: 0.328654 Apr 12 00:33:53 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 105/302] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:33:52 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 1731 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:33:53 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-007d3385-f38e-4b6a-a777-89bdae4db8a8 req-12a76ed4-5f93-47a8-820e-24be41279737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe6d6bc-65a6-469a-89a0-7e4c51620b14", "name": "network-vif-unplugged", "status": "completed", "tag": "b99b54c2-0b21-42ea-91d0-087aa230da7e"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:53 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-007d3385-f38e-4b6a-a777-89bdae4db8a8 req-12a76ed4-5f93-47a8-820e-24be41279737 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:53 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-007d3385-f38e-4b6a-a777-89bdae4db8a8 req-12a76ed4-5f93-47a8-820e-24be41279737 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:53 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-007d3385-f38e-4b6a-a777-89bdae4db8a8 req-12a76ed4-5f93-47a8-820e-24be41279737 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:53 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-007d3385-f38e-4b6a-a777-89bdae4db8a8 req-12a76ed4-5f93-47a8-820e-24be41279737 service nova] Creating event network-vif-unplugged:b99b54c2-0b21-42ea-91d0-087aa230da7e for instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 on user Apr 12 00:33:53 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-007d3385-f38e-4b6a-a777-89bdae4db8a8 req-12a76ed4-5f93-47a8-820e-24be41279737 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030673 Apr 12 00:33:53 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 100/303] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:33:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:55 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-f7821e60-7543-4915-a749-9dd10fc99276 req-1b412532-d2fa-4ddf-bd90-c31e0ecdd260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8833bad-d30f-4cd4-aa66-10d60c782061", "tag": "5512329a-21f4-4114-b881-ede435da55c8"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:55 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f7821e60-7543-4915-a749-9dd10fc99276 req-1b412532-d2fa-4ddf-bd90-c31e0ecdd260 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:55 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f7821e60-7543-4915-a749-9dd10fc99276 req-1b412532-d2fa-4ddf-bd90-c31e0ecdd260 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:55 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f7821e60-7543-4915-a749-9dd10fc99276 req-1b412532-d2fa-4ddf-bd90-c31e0ecdd260 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:55 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-f7821e60-7543-4915-a749-9dd10fc99276 req-1b412532-d2fa-4ddf-bd90-c31e0ecdd260 service nova] Creating event network-changed:5512329a-21f4-4114-b881-ede435da55c8 for instance d8833bad-d30f-4cd4-aa66-10d60c782061 on user Apr 12 00:33:55 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-f7821e60-7543-4915-a749-9dd10fc99276 req-1b412532-d2fa-4ddf-bd90-c31e0ecdd260 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074328 Apr 12 00:33:55 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 99/304] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:33:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:55 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-be034591-e1a9-4a8c-8dc9-7b340422dc12 req-101871d5-8b0f-4d9c-8515-34af2af104f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe6d6bc-65a6-469a-89a0-7e4c51620b14", "name": "network-vif-plugged", "status": "completed", "tag": "b99b54c2-0b21-42ea-91d0-087aa230da7e"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:55 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-be034591-e1a9-4a8c-8dc9-7b340422dc12 req-101871d5-8b0f-4d9c-8515-34af2af104f1 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:55 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-be034591-e1a9-4a8c-8dc9-7b340422dc12 req-101871d5-8b0f-4d9c-8515-34af2af104f1 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:55 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-be034591-e1a9-4a8c-8dc9-7b340422dc12 req-101871d5-8b0f-4d9c-8515-34af2af104f1 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:55 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-be034591-e1a9-4a8c-8dc9-7b340422dc12 req-101871d5-8b0f-4d9c-8515-34af2af104f1 service nova] Creating event network-vif-plugged:b99b54c2-0b21-42ea-91d0-087aa230da7e for instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 on user Apr 12 00:33:55 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-be034591-e1a9-4a8c-8dc9-7b340422dc12 req-101871d5-8b0f-4d9c-8515-34af2af104f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037175 Apr 12 00:33:55 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 106/305] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:33:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:33:55 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-039570bc-8a2e-42ef-98b4-6c70dcc50cee tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:33:55 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-039570bc-8a2e-42ef-98b4-6c70dcc50cee tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:55 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-039570bc-8a2e-42ef-98b4-6c70dcc50cee tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:55 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-039570bc-8a2e-42ef-98b4-6c70dcc50cee tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:55 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-039570bc-8a2e-42ef-98b4-6c70dcc50cee tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:55 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-039570bc-8a2e-42ef-98b4-6c70dcc50cee tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:55 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-039570bc-8a2e-42ef-98b4-6c70dcc50cee tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:55 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-039570bc-8a2e-42ef-98b4-6c70dcc50cee tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:56 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-039570bc-8a2e-42ef-98b4-6c70dcc50cee tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057280 Apr 12 00:33:56 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 101/306] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:33:55 2023] GET /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:33:58 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-1244647299"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:33:58 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:33:58 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:58 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:58 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:58 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:33:58 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:33:58 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:33:59 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-d4ddcadb-c726-456f-bd34-adc13c4c2f18 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749/action" status: 202 len: 0 microversion: 2.1 time: 0.992768 Apr 12 00:33:59 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 100/307] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 00:33:58 2023] POST /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749/action => generated 0 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 12 00:34:00 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:34:00 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-33d181e2-2ce6-4bd4-8c5b-8ee6da7ced19 req-e96ee93a-3f23-4b16-a130-c6330174f63e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8833bad-d30f-4cd4-aa66-10d60c782061", "name": "network-vif-plugged", "status": "completed", "tag": "5512329a-21f4-4114-b881-ede435da55c8"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-33d181e2-2ce6-4bd4-8c5b-8ee6da7ced19 req-e96ee93a-3f23-4b16-a130-c6330174f63e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-33d181e2-2ce6-4bd4-8c5b-8ee6da7ced19 req-e96ee93a-3f23-4b16-a130-c6330174f63e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-33d181e2-2ce6-4bd4-8c5b-8ee6da7ced19 req-e96ee93a-3f23-4b16-a130-c6330174f63e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:00 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-33d181e2-2ce6-4bd4-8c5b-8ee6da7ced19 req-e96ee93a-3f23-4b16-a130-c6330174f63e service nova] Creating event network-vif-plugged:5512329a-21f4-4114-b881-ede435da55c8 for instance d8833bad-d30f-4cd4-aa66-10d60c782061 on user Apr 12 00:34:00 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-33d181e2-2ce6-4bd4-8c5b-8ee6da7ced19 req-e96ee93a-3f23-4b16-a130-c6330174f63e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095006 Apr 12 00:34:00 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 107/308] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:34:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:34:02 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-5e5f71d4-84b2-494a-8563-2ea3d7dbce3b req-9508b8bd-7e5c-4749-983d-3c25b6785a78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8833bad-d30f-4cd4-aa66-10d60c782061", "name": "network-vif-plugged", "status": "completed", "tag": "5512329a-21f4-4114-b881-ede435da55c8"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:02 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-5e5f71d4-84b2-494a-8563-2ea3d7dbce3b req-9508b8bd-7e5c-4749-983d-3c25b6785a78 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:02 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-5e5f71d4-84b2-494a-8563-2ea3d7dbce3b req-9508b8bd-7e5c-4749-983d-3c25b6785a78 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:02 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-5e5f71d4-84b2-494a-8563-2ea3d7dbce3b req-9508b8bd-7e5c-4749-983d-3c25b6785a78 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:02 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-5e5f71d4-84b2-494a-8563-2ea3d7dbce3b req-9508b8bd-7e5c-4749-983d-3c25b6785a78 service nova] Creating event network-vif-plugged:5512329a-21f4-4114-b881-ede435da55c8 for instance d8833bad-d30f-4cd4-aa66-10d60c782061 on user Apr 12 00:34:02 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-5e5f71d4-84b2-494a-8563-2ea3d7dbce3b req-9508b8bd-7e5c-4749-983d-3c25b6785a78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031217 Apr 12 00:34:02 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 102/309] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:34:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:34:06 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=4 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:34:06 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=12 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:34:06 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-dda2fa62-60b7-4237-b17e-7f054ee5467f req-8dddb97b-691c-4f91-b2d1-a637689b5fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe6d6bc-65a6-469a-89a0-7e4c51620b14", "name": "network-vif-plugged", "status": "completed", "tag": "b99b54c2-0b21-42ea-91d0-087aa230da7e"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:06 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-dda2fa62-60b7-4237-b17e-7f054ee5467f req-8dddb97b-691c-4f91-b2d1-a637689b5fb8 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:06 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-dda2fa62-60b7-4237-b17e-7f054ee5467f req-8dddb97b-691c-4f91-b2d1-a637689b5fb8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:06 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-dda2fa62-60b7-4237-b17e-7f054ee5467f req-8dddb97b-691c-4f91-b2d1-a637689b5fb8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:06 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-dda2fa62-60b7-4237-b17e-7f054ee5467f req-8dddb97b-691c-4f91-b2d1-a637689b5fb8 service nova] Creating event network-vif-plugged:b99b54c2-0b21-42ea-91d0-087aa230da7e for instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 on user Apr 12 00:34:06 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-dda2fa62-60b7-4237-b17e-7f054ee5467f req-8dddb97b-691c-4f91-b2d1-a637689b5fb8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075221 Apr 12 00:34:06 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 101/310] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:34:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:34:06 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-bd42ef91-ca69-4ff1-91e9-1fd662dd8b64 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Action: 'create', calling method: .version_select at 0x7f7cd47cdcf0>, body: {"keypair": {"name": "tempest-keypair-1703783656", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIysUobFmc9X5YdnMYwlIEcSJnigDvHGxIpk+TP1afUFzLWmVglTO+snpoAKu69KheIwgjwoZA4vqNtG3U+76qhSJXgwg/N8/c0zXljFc8EJZe2wiop3pLQC7bMyegVYkg=="}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:06 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-bd42ef91-ca69-4ff1-91e9-1fd662dd8b64 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Getting quotas for project b56f3c567dc84773a33d596920df727a. Resources: {'key_pairs'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:34:06 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-bd42ef91-ca69-4ff1-91e9-1fd662dd8b64 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Getting quotas for user d373f582479c441e8ce9849ca694a186 and project b56f3c567dc84773a33d596920df727a. Resources: {'key_pairs'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:34:06 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-bd42ef91-ca69-4ff1-91e9-1fd662dd8b64 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.231007 Apr 12 00:34:06 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 108/311] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 00:34:06 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:34:08 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-fecf22fd-5c89-48a4-9fae-3b933d30c1d3 req-be4662ff-9a7a-46dd-9c3f-a4205e642975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe6d6bc-65a6-469a-89a0-7e4c51620b14", "name": "network-vif-plugged", "status": "completed", "tag": "b99b54c2-0b21-42ea-91d0-087aa230da7e"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-fecf22fd-5c89-48a4-9fae-3b933d30c1d3 req-be4662ff-9a7a-46dd-9c3f-a4205e642975 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-fecf22fd-5c89-48a4-9fae-3b933d30c1d3 req-be4662ff-9a7a-46dd-9c3f-a4205e642975 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-fecf22fd-5c89-48a4-9fae-3b933d30c1d3 req-be4662ff-9a7a-46dd-9c3f-a4205e642975 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:08 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-fecf22fd-5c89-48a4-9fae-3b933d30c1d3 req-be4662ff-9a7a-46dd-9c3f-a4205e642975 service nova] Creating event network-vif-plugged:b99b54c2-0b21-42ea-91d0-087aa230da7e for instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 on user Apr 12 00:34:08 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-fecf22fd-5c89-48a4-9fae-3b933d30c1d3 req-be4662ff-9a7a-46dd-9c3f-a4205e642975 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053671 Apr 12 00:34:08 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 103/312] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:34:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:34:08 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1467071576", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1"}], "security_groups": [{"name": "tempest-securitygroup--1053123925"}], "key_name": "tempest-keypair-1703783656", "user_data": "}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:08 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1092112857", "imageRef": "1477c510-1b10-4162-b311-b1e0e3aeefda", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1883128824", "security_groups": [{"name": "tempest-secgroup-smoke-518855564"}], "networks": [{"uuid": "193a75a6-a349-4ef2-9598-e9d4b3c476c4"}]}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:08 user devstack@n-api.service[72494]: DEBUG nova.network.neutron [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] validate_networks() for [('df248eb3-f39c-4a81-aca0-6c2d01f6d2b1', None, None, None, None, None)] {{(pid=72494) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:34:08 user devstack@n-api.service[72496]: DEBUG nova.network.neutron [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] validate_networks() for [('193a75a6-a349-4ef2-9598-e9d4b3c476c4', None, None, None, None, None)] {{(pid=72496) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:34:09 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Flavor limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:34:09 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Image limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:34:09 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Flavor pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:34:09 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Image pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:34:09 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:34:09 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Flavor limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:34:09 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Image limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:34:09 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Flavor pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:34:09 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Image pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:34:09 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:34:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:09 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Getting quotas for project ca0ea21a2d4d400cba79444c68b58aed. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:34:09 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Getting quotas for user 0e843a45549943cb88b1b3123a2fbe8a and project ca0ea21a2d4d400cba79444c68b58aed. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:34:09 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Getting quotas for project b56f3c567dc84773a33d596920df727a. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:34:09 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Getting quotas for user d373f582479c441e8ce9849ca694a186 and project b56f3c567dc84773a33d596920df727a. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:34:09 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Going to run 1 instances... {{(pid=72496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:34:09 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1477c510-1b10-4162-b311-b1e0e3aeefda',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:34:09 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Going to run 1 instances... {{(pid=72494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:34:09 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:34:09 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-50c5c7b9-a29c-4689-8a9f-de851bf7066d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.910830 Apr 12 00:34:09 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 109/313] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:34:08 2023] POST /compute/v2.1/servers => generated 403 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:34:09 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-675c2760-883d-4cec-9bb2-bda3c3bf21cc tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:09 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-675c2760-883d-4cec-9bb2-bda3c3bf21cc tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:34:09 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-fe5976c2-c5b9-4de6-bc0a-95e48d2f3991 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.963988 Apr 12 00:34:09 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 102/314] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:34:08 2023] POST /compute/v2.1/servers => generated 400 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:34:09 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-0aefc673-c22f-4c21-a44a-53b9f5673432 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:09 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-0aefc673-c22f-4c21-a44a-53b9f5673432 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:34:09 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-675c2760-883d-4cec-9bb2-bda3c3bf21cc tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e843a45549943cb88b1b3123a2fbe8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0ea21a2d4d400cba79444c68b58aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:34:09 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-675c2760-883d-4cec-9bb2-bda3c3bf21cc tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c1ae397-d28d-4143-9aa1-cf00e799f9b5" status: 200 len: 1237 microversion: 2.1 time: 0.095444 Apr 12 00:34:09 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 104/315] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:34:09 2023] GET /compute/v2.1/servers/6c1ae397-d28d-4143-9aa1-cf00e799f9b5 => generated 1237 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:09 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-0aefc673-c22f-4c21-a44a-53b9f5673432 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373f582479c441e8ce9849ca694a186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f3c567dc84773a33d596920df727a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:34:09 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-0aefc673-c22f-4c21-a44a-53b9f5673432 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a" status: 200 len: 1236 microversion: 2.1 time: 0.090441 Apr 12 00:34:09 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 110/316] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:34:09 2023] GET /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a => generated 1236 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:11 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-d360a4b0-e409-4a50-bb32-183019ff2017 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:11 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-d360a4b0-e409-4a50-bb32-183019ff2017 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:34:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d360a4b0-e409-4a50-bb32-183019ff2017 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d360a4b0-e409-4a50-bb32-183019ff2017 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d360a4b0-e409-4a50-bb32-183019ff2017 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d360a4b0-e409-4a50-bb32-183019ff2017 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d360a4b0-e409-4a50-bb32-183019ff2017 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d360a4b0-e409-4a50-bb32-183019ff2017 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:11 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-d360a4b0-e409-4a50-bb32-183019ff2017 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391e2cd0c34b4e838c4cf86ba933270c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bc7149e49343889c32fc198b6a0500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:34:11 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-d360a4b0-e409-4a50-bb32-183019ff2017 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff" status: 200 len: 1497 microversion: 2.1 time: 0.255644 Apr 12 00:34:11 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 103/317] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:34:11 2023] GET /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff => generated 1497 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:15 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-a08e45e8-612b-4ad5-a61f-ab76ade71a6a req-69d23b4a-6d89-4a88-a8c4-ca6480c61520 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c1ae397-d28d-4143-9aa1-cf00e799f9b5", "tag": "f0e98861-35b6-489e-9f17-463054e69601"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a08e45e8-612b-4ad5-a61f-ab76ade71a6a req-69d23b4a-6d89-4a88-a8c4-ca6480c61520 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a08e45e8-612b-4ad5-a61f-ab76ade71a6a req-69d23b4a-6d89-4a88-a8c4-ca6480c61520 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a08e45e8-612b-4ad5-a61f-ab76ade71a6a req-69d23b4a-6d89-4a88-a8c4-ca6480c61520 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:15 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-a08e45e8-612b-4ad5-a61f-ab76ade71a6a req-69d23b4a-6d89-4a88-a8c4-ca6480c61520 service nova] Creating event network-changed:f0e98861-35b6-489e-9f17-463054e69601 for instance 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 on user Apr 12 00:34:15 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-a08e45e8-612b-4ad5-a61f-ab76ade71a6a req-69d23b4a-6d89-4a88-a8c4-ca6480c61520 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029796 Apr 12 00:34:15 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 105/318] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:34:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:34:16 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1849840891", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "networks": [{"uuid": "904a9a3f-6997-40cc-bf7d-26952bba0f10"}]}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:16 user devstack@n-api.service[72496]: DEBUG nova.network.neutron [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] validate_networks() for [('904a9a3f-6997-40cc-bf7d-26952bba0f10', None, None, None, None, None)] {{(pid=72496) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:34:16 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-d40f75e0-8405-4293-bdc8-115d2a99a21b tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:16 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-d40f75e0-8405-4293-bdc8-115d2a99a21b tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:34:16 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d40f75e0-8405-4293-bdc8-115d2a99a21b tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:16 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d40f75e0-8405-4293-bdc8-115d2a99a21b tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:16 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d40f75e0-8405-4293-bdc8-115d2a99a21b tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:16 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d40f75e0-8405-4293-bdc8-115d2a99a21b tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:16 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d40f75e0-8405-4293-bdc8-115d2a99a21b tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:16 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d40f75e0-8405-4293-bdc8-115d2a99a21b tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:16 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-d40f75e0-8405-4293-bdc8-115d2a99a21b tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] HTTP exception thrown: Instance f9dc12da-4db1-4305-93ea-2bd63870c097 could not be found. Apr 12 00:34:16 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-d40f75e0-8405-4293-bdc8-115d2a99a21b tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Request method failure captured: Apr 12 00:34:16 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097 HTTP/1.1 Apr 12 00:34:16 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:34:16 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:34:16 user devstack@n-api.service[72494]: Connection: close Apr 12 00:34:16 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:34:16 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:34:16 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:34:16 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:34:16 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:34:16 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNft9X-4OagfdfAJCWnMBEm-OziStAizK44-6Iity-X-hAAPy8O4thlfR5LMJXv2upTX9TA0IFoDqEB3RJK0vqAQLeNrsu1kmmD6AxuzH3hCiaD6hRB8rkCD9dZFGkwHWQccWFLLa3Wi7hS6amgvR6kBClotWcZU0TXh07Sii_-9wFAA Apr 12 00:34:16 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:34:16 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:34:16 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:34:16 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:34:16 user devstack@n-api.service[72494]: X-Openstack-Nova-Api-Version: 2.49 Apr 12 00:34:16 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:34:16 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:34:16 user devstack@n-api.service[72494]: X-Project-Id: e7abb0634c7c44699a5197b9876b612c Apr 12 00:34:16 user devstack@n-api.service[72494]: X-Project-Name: tempest-TaggedAttachmentsTest-552970798 Apr 12 00:34:16 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:34:16 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:34:16 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e7abb0634c7c44699a5197b9876b612c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e7abb0634c7c44699a5197b9876b612c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e7abb0634c7c44699a5197b9876b612c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:34:16 user devstack@n-api.service[72494]: X-Tenant: tempest-TaggedAttachmentsTest-552970798 Apr 12 00:34:16 user devstack@n-api.service[72494]: X-Tenant-Id: e7abb0634c7c44699a5197b9876b612c Apr 12 00:34:16 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-TaggedAttachmentsTest-552970798 Apr 12 00:34:16 user devstack@n-api.service[72494]: X-User: tempest-TaggedAttachmentsTest-552970798-project-member Apr 12 00:34:16 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:34:16 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:34:16 user devstack@n-api.service[72494]: X-User-Id: 3dae26de34e047b8b4fe08b2e56a4b62 Apr 12 00:34:16 user devstack@n-api.service[72494]: X-User-Name: tempest-TaggedAttachmentsTest-552970798-project-member Apr 12 00:34:16 user devstack@n-api.service[72494]: method: > Apr 12 00:34:16 user devstack@n-api.service[72494]: exception: Instance f9dc12da-4db1-4305-93ea-2bd63870c097 could not be found. Apr 12 00:34:16 user devstack@n-api.service[72494]: action_args: {'id': 'f9dc12da-4db1-4305-93ea-2bd63870c097'} Apr 12 00:34:16 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9dc12da-4db1-4305-93ea-2bd63870c097 could not be found. Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9dc12da-4db1-4305-93ea-2bd63870c097 could not be found. Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9dc12da-4db1-4305-93ea-2bd63870c097 could not be found. Apr 12 00:34:16 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:34:16 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-d40f75e0-8405-4293-bdc8-115d2a99a21b tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Returning 404 to user: Instance f9dc12da-4db1-4305-93ea-2bd63870c097 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:34:16 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-d40f75e0-8405-4293-bdc8-115d2a99a21b tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097" status: 404 len: 111 microversion: 2.49 time: 0.047504 Apr 12 00:34:16 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 104/319] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:34:16 2023] GET /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:34:16 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-38a194b2-903f-4611-b8b3-928ecd729658 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:16 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-38a194b2-903f-4611-b8b3-928ecd729658 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:34:16 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-8444d8e9-387a-4c52-a1d2-2e3f2cba7e49 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Calling method '.version_select at 0x7f7cd489e560>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:16 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-38a194b2-903f-4611-b8b3-928ecd729658 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:16 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-38a194b2-903f-4611-b8b3-928ecd729658 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:16 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-38a194b2-903f-4611-b8b3-928ecd729658 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:16 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-38a194b2-903f-4611-b8b3-928ecd729658 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:16 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-38a194b2-903f-4611-b8b3-928ecd729658 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:16 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-38a194b2-903f-4611-b8b3-928ecd729658 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:16 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-8444d8e9-387a-4c52-a1d2-2e3f2cba7e49 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-471743196" status: 204 len: 0 microversion: 2.49 time: 0.032183 Apr 12 00:34:16 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 105/320] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 12 00:34:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-471743196 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 12 00:34:16 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-38a194b2-903f-4611-b8b3-928ecd729658 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] HTTP exception thrown: Instance 570abef1-f803-4f3e-8051-b6f690063496 could not be found. Apr 12 00:34:16 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-38a194b2-903f-4611-b8b3-928ecd729658 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Request method failure captured: Apr 12 00:34:16 user devstack@n-api.service[72495]: request: GET /compute/v2.1/servers/570abef1-f803-4f3e-8051-b6f690063496 HTTP/1.1 Apr 12 00:34:16 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:34:16 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:34:16 user devstack@n-api.service[72495]: Connection: close Apr 12 00:34:16 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 00:34:16 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:34:16 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:34:16 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:34:16 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:34:16 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNft1qKkmjD8Nll-qUgF19N1LJeB8PdcRbdn5Uq6buO7cPBS5Ov8OoI4tZ5vt-jvCknrLUCUXFnwniWtwxerLQ3Ye5xXh85fQ6mUUIOhguVUuxf5ZIys8tRE0XamxX86aNJtrX6fu_BHxUNtwTPq_PEt8q2KNpjT1y3XmuQXDJ2yaqus Apr 12 00:34:16 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:34:16 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:34:16 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:34:16 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:34:16 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:34:16 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:34:16 user devstack@n-api.service[72495]: X-Project-Id: 6ee31cdc6f4e4c2b9a8ec1e1c5076010 Apr 12 00:34:16 user devstack@n-api.service[72495]: X-Project-Name: tempest-ServersNegativeTestJSON-103053763 Apr 12 00:34:16 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:34:16 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:34:16 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ee31cdc6f4e4c2b9a8ec1e1c5076010"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6ee31cdc6f4e4c2b9a8ec1e1c5076010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ee31cdc6f4e4c2b9a8ec1e1c5076010"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:34:16 user devstack@n-api.service[72495]: X-Tenant: tempest-ServersNegativeTestJSON-103053763 Apr 12 00:34:16 user devstack@n-api.service[72495]: X-Tenant-Id: 6ee31cdc6f4e4c2b9a8ec1e1c5076010 Apr 12 00:34:16 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-ServersNegativeTestJSON-103053763 Apr 12 00:34:16 user devstack@n-api.service[72495]: X-User: tempest-ServersNegativeTestJSON-103053763-project-member Apr 12 00:34:16 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:34:16 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:34:16 user devstack@n-api.service[72495]: X-User-Id: 920d6d79e38e45fcb5153e712605764f Apr 12 00:34:16 user devstack@n-api.service[72495]: X-User-Name: tempest-ServersNegativeTestJSON-103053763-project-member Apr 12 00:34:16 user devstack@n-api.service[72495]: method: > Apr 12 00:34:16 user devstack@n-api.service[72495]: exception: Instance 570abef1-f803-4f3e-8051-b6f690063496 could not be found. Apr 12 00:34:16 user devstack@n-api.service[72495]: action_args: {'id': '570abef1-f803-4f3e-8051-b6f690063496'} Apr 12 00:34:16 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 570abef1-f803-4f3e-8051-b6f690063496 could not be found. Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 570abef1-f803-4f3e-8051-b6f690063496 could not be found. Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 570abef1-f803-4f3e-8051-b6f690063496 could not be found. Apr 12 00:34:16 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:34:16 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-38a194b2-903f-4611-b8b3-928ecd729658 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Returning 404 to user: Instance 570abef1-f803-4f3e-8051-b6f690063496 could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:34:16 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-38a194b2-903f-4611-b8b3-928ecd729658 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] 10.0.0.210 "GET /compute/v2.1/servers/570abef1-f803-4f3e-8051-b6f690063496" status: 404 len: 111 microversion: 2.1 time: 0.069956 Apr 12 00:34:16 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 106/321] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:34:16 2023] GET /compute/v2.1/servers/570abef1-f803-4f3e-8051-b6f690063496 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:34:16 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-a1918e27-91dc-4b6a-a66a-db5d1b0ea81b tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:16 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-a1918e27-91dc-4b6a-a66a-db5d1b0ea81b tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:34:16 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a1918e27-91dc-4b6a-a66a-db5d1b0ea81b tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:16 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a1918e27-91dc-4b6a-a66a-db5d1b0ea81b tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:16 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a1918e27-91dc-4b6a-a66a-db5d1b0ea81b tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:16 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a1918e27-91dc-4b6a-a66a-db5d1b0ea81b tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:16 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a1918e27-91dc-4b6a-a66a-db5d1b0ea81b tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:16 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a1918e27-91dc-4b6a-a66a-db5d1b0ea81b tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:16 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Flavor limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:34:16 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Image limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:34:16 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Flavor pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:34:16 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Image pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:34:16 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:34:16 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:16 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:16 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:16 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:16 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:16 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:16 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Getting quotas for project 48be6d35ad6c43c8b048811baffb8da8. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:34:16 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Getting quotas for user f6d875a6e14446469a8a58b97a0e89d4 and project 48be6d35ad6c43c8b048811baffb8da8. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:34:16 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Going to run 1 instances... {{(pid=72496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:34:16 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:34:16 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-a1918e27-91dc-4b6a-a66a-db5d1b0ea81b tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920d6d79e38e45fcb5153e712605764f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee31cdc6f4e4c2b9a8ec1e1c5076010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:34:16 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-a1918e27-91dc-4b6a-a66a-db5d1b0ea81b tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" status: 200 len: 1493 microversion: 2.1 time: 0.210860 Apr 12 00:34:16 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 106/322] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:34:16 2023] GET /compute/v2.1/servers/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 => generated 1493 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:17 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-f3d4c0b6-150a-4c15-bad4-c8856f944bf3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.776604 Apr 12 00:34:17 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 111/323] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:34:16 2023] POST /compute/v2.1/servers => generated 378 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:34:17 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-32fe47a7-7956-41cf-b055-b50c319992a4 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:17 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-32fe47a7-7956-41cf-b055-b50c319992a4 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:34:17 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-2319b051-6805-445b-a7ec-4353f5f1aafc tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:17 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-2319b051-6805-445b-a7ec-4353f5f1aafc tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:34:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2319b051-6805-445b-a7ec-4353f5f1aafc tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2319b051-6805-445b-a7ec-4353f5f1aafc tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2319b051-6805-445b-a7ec-4353f5f1aafc tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2319b051-6805-445b-a7ec-4353f5f1aafc tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2319b051-6805-445b-a7ec-4353f5f1aafc tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2319b051-6805-445b-a7ec-4353f5f1aafc tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:17 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-2319b051-6805-445b-a7ec-4353f5f1aafc tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084817 Apr 12 00:34:17 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 107/324] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:34:17 2023] GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:34:17 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-32fe47a7-7956-41cf-b055-b50c319992a4 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d875a6e14446469a8a58b97a0e89d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48be6d35ad6c43c8b048811baffb8da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:34:17 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-32fe47a7-7956-41cf-b055-b50c319992a4 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b203e2e-a2ba-4989-94bc-2a78491a9b89" status: 200 len: 1208 microversion: 2.1 time: 0.110464 Apr 12 00:34:17 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 107/325] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:34:17 2023] GET /compute/v2.1/servers/1b203e2e-a2ba-4989-94bc-2a78491a9b89 => generated 1208 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:17 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-358c1dfb-5539-4657-83ee-5325ec577b83 req-85447ecb-732b-451f-8d24-5bfee540e87e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bae2f38-fd5e-4d51-be63-22bbf54cd77a", "tag": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-358c1dfb-5539-4657-83ee-5325ec577b83 req-85447ecb-732b-451f-8d24-5bfee540e87e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-358c1dfb-5539-4657-83ee-5325ec577b83 req-85447ecb-732b-451f-8d24-5bfee540e87e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-358c1dfb-5539-4657-83ee-5325ec577b83 req-85447ecb-732b-451f-8d24-5bfee540e87e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:17 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-358c1dfb-5539-4657-83ee-5325ec577b83 req-85447ecb-732b-451f-8d24-5bfee540e87e service nova] Creating event network-changed:a152413c-fa33-4f4e-8c91-2b8a8c5565b6 for instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a on user Apr 12 00:34:17 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-358c1dfb-5539-4657-83ee-5325ec577b83 req-85447ecb-732b-451f-8d24-5bfee540e87e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054014 Apr 12 00:34:17 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 112/326] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:34:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:34:18 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-db719a58-5631-4801-9473-dc246d939673 req-c5638a29-9940-41cd-a1ce-2a616ab8cc55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c1ae397-d28d-4143-9aa1-cf00e799f9b5", "name": "network-vif-plugged", "status": "completed", "tag": "f0e98861-35b6-489e-9f17-463054e69601"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-db719a58-5631-4801-9473-dc246d939673 req-c5638a29-9940-41cd-a1ce-2a616ab8cc55 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-db719a58-5631-4801-9473-dc246d939673 req-c5638a29-9940-41cd-a1ce-2a616ab8cc55 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-db719a58-5631-4801-9473-dc246d939673 req-c5638a29-9940-41cd-a1ce-2a616ab8cc55 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:18 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-db719a58-5631-4801-9473-dc246d939673 req-c5638a29-9940-41cd-a1ce-2a616ab8cc55 service nova] Creating event network-vif-plugged:f0e98861-35b6-489e-9f17-463054e69601 for instance 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 on user Apr 12 00:34:18 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-db719a58-5631-4801-9473-dc246d939673 req-c5638a29-9940-41cd-a1ce-2a616ab8cc55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047900 Apr 12 00:34:18 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 108/327] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:34:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:34:19 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-64cee825-1c81-4f5a-b2d1-d8ca41a5a9c8 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:19 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-64cee825-1c81-4f5a-b2d1-d8ca41a5a9c8 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:34:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-64cee825-1c81-4f5a-b2d1-d8ca41a5a9c8 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-64cee825-1c81-4f5a-b2d1-d8ca41a5a9c8 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-64cee825-1c81-4f5a-b2d1-d8ca41a5a9c8 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-64cee825-1c81-4f5a-b2d1-d8ca41a5a9c8 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-64cee825-1c81-4f5a-b2d1-d8ca41a5a9c8 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-64cee825-1c81-4f5a-b2d1-d8ca41a5a9c8 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:19 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-64cee825-1c81-4f5a-b2d1-d8ca41a5a9c8 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] HTTP exception thrown: Instance f9dc12da-4db1-4305-93ea-2bd63870c097 could not be found. Apr 12 00:34:19 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-64cee825-1c81-4f5a-b2d1-d8ca41a5a9c8 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Request method failure captured: Apr 12 00:34:19 user devstack@n-api.service[72494]: request: DELETE /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097 HTTP/1.1 Apr 12 00:34:19 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:34:19 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:34:19 user devstack@n-api.service[72494]: Connection: close Apr 12 00:34:19 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:34:19 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:34:19 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:34:19 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:34:19 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:34:19 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNft9X-4OagfdfAJCWnMBEm-OziStAizK44-6Iity-X-hAAPy8O4thlfR5LMJXv2upTX9TA0IFoDqEB3RJK0vqAQLeNrsu1kmmD6AxuzH3hCiaD6hRB8rkCD9dZFGkwHWQccWFLLa3Wi7hS6amgvR6kBClotWcZU0TXh07Sii_-9wFAA Apr 12 00:34:19 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:34:19 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:34:19 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:34:19 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:34:19 user devstack@n-api.service[72494]: X-Openstack-Nova-Api-Version: 2.49 Apr 12 00:34:19 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:34:19 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:34:19 user devstack@n-api.service[72494]: X-Project-Id: e7abb0634c7c44699a5197b9876b612c Apr 12 00:34:19 user devstack@n-api.service[72494]: X-Project-Name: tempest-TaggedAttachmentsTest-552970798 Apr 12 00:34:19 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:34:19 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:34:19 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e7abb0634c7c44699a5197b9876b612c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e7abb0634c7c44699a5197b9876b612c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e7abb0634c7c44699a5197b9876b612c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:34:19 user devstack@n-api.service[72494]: X-Tenant: tempest-TaggedAttachmentsTest-552970798 Apr 12 00:34:19 user devstack@n-api.service[72494]: X-Tenant-Id: e7abb0634c7c44699a5197b9876b612c Apr 12 00:34:19 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-TaggedAttachmentsTest-552970798 Apr 12 00:34:19 user devstack@n-api.service[72494]: X-User: tempest-TaggedAttachmentsTest-552970798-project-member Apr 12 00:34:19 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:34:19 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:34:19 user devstack@n-api.service[72494]: X-User-Id: 3dae26de34e047b8b4fe08b2e56a4b62 Apr 12 00:34:19 user devstack@n-api.service[72494]: X-User-Name: tempest-TaggedAttachmentsTest-552970798-project-member Apr 12 00:34:19 user devstack@n-api.service[72494]: method: > Apr 12 00:34:19 user devstack@n-api.service[72494]: exception: Instance f9dc12da-4db1-4305-93ea-2bd63870c097 could not be found. Apr 12 00:34:19 user devstack@n-api.service[72494]: action_args: {'id': 'f9dc12da-4db1-4305-93ea-2bd63870c097'} Apr 12 00:34:19 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9dc12da-4db1-4305-93ea-2bd63870c097 could not be found. Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9dc12da-4db1-4305-93ea-2bd63870c097 could not be found. Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9dc12da-4db1-4305-93ea-2bd63870c097 could not be found. Apr 12 00:34:19 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:34:19 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-64cee825-1c81-4f5a-b2d1-d8ca41a5a9c8 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Returning 404 to user: Instance f9dc12da-4db1-4305-93ea-2bd63870c097 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:34:19 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-64cee825-1c81-4f5a-b2d1-d8ca41a5a9c8 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097" status: 404 len: 111 microversion: 2.49 time: 0.033026 Apr 12 00:34:19 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 108/328] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 00:34:19 2023] DELETE /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:34:19 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-d6cd8ce5-e3f5-4e07-bd6b-4955f42ce070 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:19 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-d6cd8ce5-e3f5-4e07-bd6b-4955f42ce070 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] [instance: f9dc12da-4db1-4305-93ea-2bd63870c097] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:34:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d6cd8ce5-e3f5-4e07-bd6b-4955f42ce070 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d6cd8ce5-e3f5-4e07-bd6b-4955f42ce070 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d6cd8ce5-e3f5-4e07-bd6b-4955f42ce070 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d6cd8ce5-e3f5-4e07-bd6b-4955f42ce070 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d6cd8ce5-e3f5-4e07-bd6b-4955f42ce070 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d6cd8ce5-e3f5-4e07-bd6b-4955f42ce070 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:19 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-d6cd8ce5-e3f5-4e07-bd6b-4955f42ce070 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] HTTP exception thrown: Instance f9dc12da-4db1-4305-93ea-2bd63870c097 could not be found. Apr 12 00:34:19 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-d6cd8ce5-e3f5-4e07-bd6b-4955f42ce070 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Request method failure captured: Apr 12 00:34:19 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097 HTTP/1.1 Apr 12 00:34:19 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:34:19 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:34:19 user devstack@n-api.service[72496]: Connection: close Apr 12 00:34:19 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:34:19 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:34:19 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:34:19 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:34:19 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:34:19 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNft9X-4OagfdfAJCWnMBEm-OziStAizK44-6Iity-X-hAAPy8O4thlfR5LMJXv2upTX9TA0IFoDqEB3RJK0vqAQLeNrsu1kmmD6AxuzH3hCiaD6hRB8rkCD9dZFGkwHWQccWFLLa3Wi7hS6amgvR6kBClotWcZU0TXh07Sii_-9wFAA Apr 12 00:34:19 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:34:19 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:34:19 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:34:19 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:34:19 user devstack@n-api.service[72496]: X-Openstack-Nova-Api-Version: 2.49 Apr 12 00:34:19 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:34:19 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:34:19 user devstack@n-api.service[72496]: X-Project-Id: e7abb0634c7c44699a5197b9876b612c Apr 12 00:34:19 user devstack@n-api.service[72496]: X-Project-Name: tempest-TaggedAttachmentsTest-552970798 Apr 12 00:34:19 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:34:19 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:34:19 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e7abb0634c7c44699a5197b9876b612c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e7abb0634c7c44699a5197b9876b612c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e7abb0634c7c44699a5197b9876b612c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:34:19 user devstack@n-api.service[72496]: X-Tenant: tempest-TaggedAttachmentsTest-552970798 Apr 12 00:34:19 user devstack@n-api.service[72496]: X-Tenant-Id: e7abb0634c7c44699a5197b9876b612c Apr 12 00:34:19 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-TaggedAttachmentsTest-552970798 Apr 12 00:34:19 user devstack@n-api.service[72496]: X-User: tempest-TaggedAttachmentsTest-552970798-project-member Apr 12 00:34:19 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:34:19 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:34:19 user devstack@n-api.service[72496]: X-User-Id: 3dae26de34e047b8b4fe08b2e56a4b62 Apr 12 00:34:19 user devstack@n-api.service[72496]: X-User-Name: tempest-TaggedAttachmentsTest-552970798-project-member Apr 12 00:34:19 user devstack@n-api.service[72496]: method: > Apr 12 00:34:19 user devstack@n-api.service[72496]: exception: Instance f9dc12da-4db1-4305-93ea-2bd63870c097 could not be found. Apr 12 00:34:19 user devstack@n-api.service[72496]: action_args: {'id': 'f9dc12da-4db1-4305-93ea-2bd63870c097'} Apr 12 00:34:19 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9dc12da-4db1-4305-93ea-2bd63870c097 could not be found. Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9dc12da-4db1-4305-93ea-2bd63870c097 could not be found. Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9dc12da-4db1-4305-93ea-2bd63870c097 could not be found. Apr 12 00:34:19 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:34:19 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-d6cd8ce5-e3f5-4e07-bd6b-4955f42ce070 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] Returning 404 to user: Instance f9dc12da-4db1-4305-93ea-2bd63870c097 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:34:19 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-d6cd8ce5-e3f5-4e07-bd6b-4955f42ce070 tempest-TaggedAttachmentsTest-552970798 tempest-TaggedAttachmentsTest-552970798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097" status: 404 len: 111 microversion: 2.49 time: 0.034988 Apr 12 00:34:19 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 113/329] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:34:19 2023] GET /compute/v2.1/servers/f9dc12da-4db1-4305-93ea-2bd63870c097 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:34:19 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:34:19 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e216a462-956b-4e02-b6d1-98de85ad7929"}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:19 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:34:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:20 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-83a986d1-2a07-4f92-964e-65eb0f813317 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.474442 Apr 12 00:34:20 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 109/330] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 00:34:19 2023] POST /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments => generated 194 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:34:20 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:34:20 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c1ae397-d28d-4143-9aa1-cf00e799f9b5", "name": "network-vif-plugged", "status": "completed", "tag": "f0e98861-35b6-489e-9f17-463054e69601"}, {"server_uuid": "2bae2f38-fd5e-4d51-be63-22bbf54cd77a", "name": "network-vif-plugged", "status": "completed", "tag": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6"}, {"server_uuid": "2bae2f38-fd5e-4d51-be63-22bbf54cd77a", "name": "network-vif-plugged", "status": "completed", "tag": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:20 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:34:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:20 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] Creating event network-vif-plugged:f0e98861-35b6-489e-9f17-463054e69601 for instance 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 on user Apr 12 00:34:20 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] Creating event network-vif-plugged:a152413c-fa33-4f4e-8c91-2b8a8c5565b6 for instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a on user Apr 12 00:34:20 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] Creating event network-vif-plugged:a152413c-fa33-4f4e-8c91-2b8a8c5565b6 for instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a on user Apr 12 00:34:20 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-6e13b034-7110-48f5-8cb6-bff91add5f67 req-99ed9f0c-fac1-4743-999d-5df7a94bf092 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.058340 Apr 12 00:34:20 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 109/331] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:34:20 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:34:20 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-f7e4fa2b-78e2-4899-91aa-eba3f282075b req-309b3cec-f897-4edb-bb86-e50a89624717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b203e2e-a2ba-4989-94bc-2a78491a9b89", "tag": "857280d0-efc9-4f7f-988a-ca07d7d5f957"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:20 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=7 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:34:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-f7e4fa2b-78e2-4899-91aa-eba3f282075b req-309b3cec-f897-4edb-bb86-e50a89624717 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-f7e4fa2b-78e2-4899-91aa-eba3f282075b req-309b3cec-f897-4edb-bb86-e50a89624717 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-f7e4fa2b-78e2-4899-91aa-eba3f282075b req-309b3cec-f897-4edb-bb86-e50a89624717 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:20 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-f7e4fa2b-78e2-4899-91aa-eba3f282075b req-309b3cec-f897-4edb-bb86-e50a89624717 service nova] Creating event network-changed:857280d0-efc9-4f7f-988a-ca07d7d5f957 for instance 1b203e2e-a2ba-4989-94bc-2a78491a9b89 on user Apr 12 00:34:20 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-f7e4fa2b-78e2-4899-91aa-eba3f282075b req-309b3cec-f897-4edb-bb86-e50a89624717 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059361 Apr 12 00:34:20 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 114/332] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:34:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:34:23 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-1e850eb7-c4ec-4de0-8f2b-bc6c20386d0e req-09a4372c-8db0-46e2-92e9-9eefc6a4b5ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b203e2e-a2ba-4989-94bc-2a78491a9b89", "name": "network-vif-plugged", "status": "completed", "tag": "857280d0-efc9-4f7f-988a-ca07d7d5f957"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:23 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=24 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:34:23 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-1e850eb7-c4ec-4de0-8f2b-bc6c20386d0e req-09a4372c-8db0-46e2-92e9-9eefc6a4b5ea service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:23 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-1e850eb7-c4ec-4de0-8f2b-bc6c20386d0e req-09a4372c-8db0-46e2-92e9-9eefc6a4b5ea service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:23 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-1e850eb7-c4ec-4de0-8f2b-bc6c20386d0e req-09a4372c-8db0-46e2-92e9-9eefc6a4b5ea service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:23 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:34:23 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-1e850eb7-c4ec-4de0-8f2b-bc6c20386d0e req-09a4372c-8db0-46e2-92e9-9eefc6a4b5ea service nova] Creating event network-vif-plugged:857280d0-efc9-4f7f-988a-ca07d7d5f957 for instance 1b203e2e-a2ba-4989-94bc-2a78491a9b89 on user Apr 12 00:34:23 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-1e850eb7-c4ec-4de0-8f2b-bc6c20386d0e req-09a4372c-8db0-46e2-92e9-9eefc6a4b5ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072231 Apr 12 00:34:23 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 110/333] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:34:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:34:25 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-b0e2a8ae-e101-4fcd-954b-47ce594b44b9 req-7a47fac6-fcbb-437c-8e46-06d8d4461b1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b203e2e-a2ba-4989-94bc-2a78491a9b89", "name": "network-vif-plugged", "status": "completed", "tag": "857280d0-efc9-4f7f-988a-ca07d7d5f957"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-b0e2a8ae-e101-4fcd-954b-47ce594b44b9 req-7a47fac6-fcbb-437c-8e46-06d8d4461b1c service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-b0e2a8ae-e101-4fcd-954b-47ce594b44b9 req-7a47fac6-fcbb-437c-8e46-06d8d4461b1c service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-b0e2a8ae-e101-4fcd-954b-47ce594b44b9 req-7a47fac6-fcbb-437c-8e46-06d8d4461b1c service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:25 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=6,nova_cell1:INSERT=3,nova_cell1:DELETE=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:34:25 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-b0e2a8ae-e101-4fcd-954b-47ce594b44b9 req-7a47fac6-fcbb-437c-8e46-06d8d4461b1c service nova] Creating event network-vif-plugged:857280d0-efc9-4f7f-988a-ca07d7d5f957 for instance 1b203e2e-a2ba-4989-94bc-2a78491a9b89 on user Apr 12 00:34:25 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-b0e2a8ae-e101-4fcd-954b-47ce594b44b9 req-7a47fac6-fcbb-437c-8e46-06d8d4461b1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050298 Apr 12 00:34:25 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 110/334] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:34:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:34:29 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:34:29 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=18 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:34:29 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:29 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:34:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:29 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=20 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:34:29 user devstack@n-api.service[72496]: DEBUG nova.objects.instance [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lazy-loading 'services' on Instance uuid 9d67708d-1bcf-4d32-8d45-22376ec72e34 {{(pid=72496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:34:30 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-d796fdf6-6dc7-431c-b00c-fc5962082a31 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments/e216a462-956b-4e02-b6d1-98de85ad7929" status: 202 len: 0 microversion: 2.1 time: 0.360303 Apr 12 00:34:30 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 115/335] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 00:34:29 2023] DELETE /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments/e216a462-956b-4e02-b6d1-98de85ad7929 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:34:30 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-9418fa7d-9e90-4b70-9dc9-59630223c582 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:30 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-9418fa7d-9e90-4b70-9dc9-59630223c582 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:34:30 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9418fa7d-9e90-4b70-9dc9-59630223c582 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:30 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9418fa7d-9e90-4b70-9dc9-59630223c582 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:30 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9418fa7d-9e90-4b70-9dc9-59630223c582 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:30 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9418fa7d-9e90-4b70-9dc9-59630223c582 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:30 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9418fa7d-9e90-4b70-9dc9-59630223c582 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:30 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9418fa7d-9e90-4b70-9dc9-59630223c582 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:30 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-9418fa7d-9e90-4b70-9dc9-59630223c582 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049751 Apr 12 00:34:30 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 111/336] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:34:30 2023] GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:34:30 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=8 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:34:30 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-8b2ebed2-3d74-43b4-9d8e-7e9855cb19ec tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:30 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-8b2ebed2-3d74-43b4-9d8e-7e9855cb19ec tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] [instance: 5be536dd-61f5-4a17-a734-029b25739a47] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:34:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8b2ebed2-3d74-43b4-9d8e-7e9855cb19ec tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8b2ebed2-3d74-43b4-9d8e-7e9855cb19ec tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8b2ebed2-3d74-43b4-9d8e-7e9855cb19ec tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8b2ebed2-3d74-43b4-9d8e-7e9855cb19ec tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8b2ebed2-3d74-43b4-9d8e-7e9855cb19ec tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8b2ebed2-3d74-43b4-9d8e-7e9855cb19ec tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:30 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-8b2ebed2-3d74-43b4-9d8e-7e9855cb19ec tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] HTTP exception thrown: Instance 5be536dd-61f5-4a17-a734-029b25739a47 could not be found. Apr 12 00:34:30 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-8b2ebed2-3d74-43b4-9d8e-7e9855cb19ec tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Request method failure captured: Apr 12 00:34:30 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47 HTTP/1.1 Apr 12 00:34:30 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:34:30 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:34:30 user devstack@n-api.service[72494]: Connection: close Apr 12 00:34:30 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:34:30 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:34:30 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:34:30 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:34:30 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:34:30 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNft5EyDIe11gsL645A0VlQbcHXsYei94WBpLDc164XTPyXUSa4Va0RnK7YUgGORt_lLXMl4U7uFSWptOdQ97Lb1RtdXS7SKletpMtxkQAGDCN5HhZdloVMiL5bqW7A9jl1dF7ChRlFAXAPcejFq79iZQinyie4QeSNoURvYZVd_cvTo Apr 12 00:34:30 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:34:30 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:34:30 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:34:30 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:34:30 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:34:30 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:34:30 user devstack@n-api.service[72494]: X-Project-Id: bff88f0df3414610858ecf3d60295c26 Apr 12 00:34:30 user devstack@n-api.service[72494]: X-Project-Name: tempest-TestVolumeSwap-1224322718 Apr 12 00:34:30 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:34:30 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:34:30 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bff88f0df3414610858ecf3d60295c26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bff88f0df3414610858ecf3d60295c26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bff88f0df3414610858ecf3d60295c26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:34:30 user devstack@n-api.service[72494]: X-Tenant: tempest-TestVolumeSwap-1224322718 Apr 12 00:34:30 user devstack@n-api.service[72494]: X-Tenant-Id: bff88f0df3414610858ecf3d60295c26 Apr 12 00:34:30 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-TestVolumeSwap-1224322718 Apr 12 00:34:30 user devstack@n-api.service[72494]: X-User: tempest-TestVolumeSwap-1224322718-project-member Apr 12 00:34:30 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:34:30 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:34:30 user devstack@n-api.service[72494]: X-User-Id: e4edaa34382341fd8f99f9d0921d80b6 Apr 12 00:34:30 user devstack@n-api.service[72494]: X-User-Name: tempest-TestVolumeSwap-1224322718-project-member Apr 12 00:34:30 user devstack@n-api.service[72494]: method: > Apr 12 00:34:30 user devstack@n-api.service[72494]: exception: Instance 5be536dd-61f5-4a17-a734-029b25739a47 could not be found. Apr 12 00:34:30 user devstack@n-api.service[72494]: action_args: {'id': '5be536dd-61f5-4a17-a734-029b25739a47'} Apr 12 00:34:30 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5be536dd-61f5-4a17-a734-029b25739a47 could not be found. Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5be536dd-61f5-4a17-a734-029b25739a47 could not be found. Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5be536dd-61f5-4a17-a734-029b25739a47 could not be found. Apr 12 00:34:30 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:34:30 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-8b2ebed2-3d74-43b4-9d8e-7e9855cb19ec tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Returning 404 to user: Instance 5be536dd-61f5-4a17-a734-029b25739a47 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:34:30 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-8b2ebed2-3d74-43b4-9d8e-7e9855cb19ec tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47" status: 404 len: 111 microversion: 2.1 time: 0.038270 Apr 12 00:34:30 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 111/337] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:34:30 2023] GET /compute/v2.1/servers/5be536dd-61f5-4a17-a734-029b25739a47 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 00:34:30 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-160da692-db70-42a3-a429-522e9804cf30 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] Calling method '.version_select at 0x7f7cd47ccdc0>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:30 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-160da692-db70-42a3-a429-522e9804cf30 tempest-TestVolumeSwap-1224322718 tempest-TestVolumeSwap-1224322718-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-436204141" status: 202 len: 0 microversion: 2.1 time: 0.028846 Apr 12 00:34:30 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 116/338] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 00:34:30 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-436204141 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:34:31 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-7fc6d854-5e93-4cee-915d-81aae8a8ae34 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:31 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-7fc6d854-5e93-4cee-915d-81aae8a8ae34 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:34:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7fc6d854-5e93-4cee-915d-81aae8a8ae34 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7fc6d854-5e93-4cee-915d-81aae8a8ae34 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7fc6d854-5e93-4cee-915d-81aae8a8ae34 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7fc6d854-5e93-4cee-915d-81aae8a8ae34 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7fc6d854-5e93-4cee-915d-81aae8a8ae34 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7fc6d854-5e93-4cee-915d-81aae8a8ae34 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:31 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-7fc6d854-5e93-4cee-915d-81aae8a8ae34 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:34:31 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-7fc6d854-5e93-4cee-915d-81aae8a8ae34 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:34:31 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-7fc6d854-5e93-4cee-915d-81aae8a8ae34 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:34:31 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-7fc6d854-5e93-4cee-915d-81aae8a8ae34 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" status: 200 len: 1692 microversion: 2.87 time: 0.487276 Apr 12 00:34:31 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 112/339] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:34:31 2023] GET /compute/v2.1/servers/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 => generated 1692 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:34:33 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:33 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:34:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:33 user devstack@n-api.service[72494]: DEBUG nova.objects.instance [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'flavor' on Instance uuid 8d895d64-319f-4c67-8c20-ef0d0437a1f0 {{(pid=72494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:34:33 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-e5f70a63-3318-418b-b6e2-45db5d3de9a3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0/action" status: 200 len: 32 microversion: 2.1 time: 0.303111 Apr 12 00:34:33 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 112/340] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 00:34:33 2023] POST /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0/action => generated 32 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:34:33 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-2883f878-e242-479e-b96e-cd38ad541621 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:33 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-2883f878-e242-479e-b96e-cd38ad541621 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:34:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2883f878-e242-479e-b96e-cd38ad541621 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2883f878-e242-479e-b96e-cd38ad541621 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2883f878-e242-479e-b96e-cd38ad541621 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2883f878-e242-479e-b96e-cd38ad541621 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2883f878-e242-479e-b96e-cd38ad541621 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2883f878-e242-479e-b96e-cd38ad541621 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:33 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-2883f878-e242-479e-b96e-cd38ad541621 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9421443b2f421298a934122c6a8b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf1fea74ef143e6b394e41e7c4ed495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:34:33 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-2883f878-e242-479e-b96e-cd38ad541621 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0" status: 200 len: 1509 microversion: 2.1 time: 0.210425 Apr 12 00:34:33 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 117/341] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:34:33 2023] GET /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0 => generated 1509 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:34 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-f24ae267-7ee2-452c-96b6-23ee29e2b1d9 req-16add126-4c72-489c-8ea9-9b980e5722b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d895d64-319f-4c67-8c20-ef0d0437a1f0", "name": "network-vif-unplugged", "status": "completed", "tag": "e92d06cb-6535-4389-b328-57add5f4f812"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-f24ae267-7ee2-452c-96b6-23ee29e2b1d9 req-16add126-4c72-489c-8ea9-9b980e5722b6 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-f24ae267-7ee2-452c-96b6-23ee29e2b1d9 req-16add126-4c72-489c-8ea9-9b980e5722b6 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-f24ae267-7ee2-452c-96b6-23ee29e2b1d9 req-16add126-4c72-489c-8ea9-9b980e5722b6 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:34 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-f24ae267-7ee2-452c-96b6-23ee29e2b1d9 req-16add126-4c72-489c-8ea9-9b980e5722b6 service nova] Creating event network-vif-unplugged:e92d06cb-6535-4389-b328-57add5f4f812 for instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 on user Apr 12 00:34:34 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-f24ae267-7ee2-452c-96b6-23ee29e2b1d9 req-16add126-4c72-489c-8ea9-9b980e5722b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053745 Apr 12 00:34:34 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 113/342] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:34:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:34:36 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-b03f1442-0432-4ee2-a40f-654f3df7c6c8 req-60ad76eb-5da6-4a51-96a8-a10a4f9ecc00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d895d64-319f-4c67-8c20-ef0d0437a1f0", "name": "network-vif-plugged", "status": "completed", "tag": "e92d06cb-6535-4389-b328-57add5f4f812"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-b03f1442-0432-4ee2-a40f-654f3df7c6c8 req-60ad76eb-5da6-4a51-96a8-a10a4f9ecc00 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-b03f1442-0432-4ee2-a40f-654f3df7c6c8 req-60ad76eb-5da6-4a51-96a8-a10a4f9ecc00 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-b03f1442-0432-4ee2-a40f-654f3df7c6c8 req-60ad76eb-5da6-4a51-96a8-a10a4f9ecc00 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:36 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-b03f1442-0432-4ee2-a40f-654f3df7c6c8 req-60ad76eb-5da6-4a51-96a8-a10a4f9ecc00 service nova] Creating event network-vif-plugged:e92d06cb-6535-4389-b328-57add5f4f812 for instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 on user Apr 12 00:34:36 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-b03f1442-0432-4ee2-a40f-654f3df7c6c8 req-60ad76eb-5da6-4a51-96a8-a10a4f9ecc00 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039094 Apr 12 00:34:36 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 113/343] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:34:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:34:38 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-c9a9a61e-0f05-4746-89c8-eb67dc1fe42b req-32e0e98c-9e87-446f-955a-3ba7282ce278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d895d64-319f-4c67-8c20-ef0d0437a1f0", "name": "network-vif-plugged", "status": "completed", "tag": "e92d06cb-6535-4389-b328-57add5f4f812"}, {"server_uuid": "8d895d64-319f-4c67-8c20-ef0d0437a1f0", "name": "network-vif-plugged", "status": "completed", "tag": "e92d06cb-6535-4389-b328-57add5f4f812"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-c9a9a61e-0f05-4746-89c8-eb67dc1fe42b req-32e0e98c-9e87-446f-955a-3ba7282ce278 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-c9a9a61e-0f05-4746-89c8-eb67dc1fe42b req-32e0e98c-9e87-446f-955a-3ba7282ce278 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-c9a9a61e-0f05-4746-89c8-eb67dc1fe42b req-32e0e98c-9e87-446f-955a-3ba7282ce278 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:38 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-c9a9a61e-0f05-4746-89c8-eb67dc1fe42b req-32e0e98c-9e87-446f-955a-3ba7282ce278 service nova] Creating event network-vif-plugged:e92d06cb-6535-4389-b328-57add5f4f812 for instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 on user Apr 12 00:34:38 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-c9a9a61e-0f05-4746-89c8-eb67dc1fe42b req-32e0e98c-9e87-446f-955a-3ba7282ce278 service nova] Creating event network-vif-plugged:e92d06cb-6535-4389-b328-57add5f4f812 for instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 on user Apr 12 00:34:38 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-c9a9a61e-0f05-4746-89c8-eb67dc1fe42b req-32e0e98c-9e87-446f-955a-3ba7282ce278 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031904 Apr 12 00:34:38 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 118/344] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:34:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:34:40 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-fa7efeb2-e6f8-4596-8bee-f3e0e8e90dc5 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:40 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-fa7efeb2-e6f8-4596-8bee-f3e0e8e90dc5 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:34:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-fa7efeb2-e6f8-4596-8bee-f3e0e8e90dc5 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-fa7efeb2-e6f8-4596-8bee-f3e0e8e90dc5 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-fa7efeb2-e6f8-4596-8bee-f3e0e8e90dc5 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-fa7efeb2-e6f8-4596-8bee-f3e0e8e90dc5 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-fa7efeb2-e6f8-4596-8bee-f3e0e8e90dc5 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-fa7efeb2-e6f8-4596-8bee-f3e0e8e90dc5 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:40 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-fa7efeb2-e6f8-4596-8bee-f3e0e8e90dc5 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:34:40 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-fa7efeb2-e6f8-4596-8bee-f3e0e8e90dc5 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8833bad-d30f-4cd4-aa66-10d60c782061" status: 200 len: 1391 microversion: 2.1 time: 0.261348 Apr 12 00:34:40 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 114/345] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:34:40 2023] GET /compute/v2.1/servers/d8833bad-d30f-4cd4-aa66-10d60c782061 => generated 1391 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:43 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-7584fa42-9889-4219-b411-7cef1e7370d0 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:43 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-7584fa42-9889-4219-b411-7cef1e7370d0 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:34:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7584fa42-9889-4219-b411-7cef1e7370d0 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7584fa42-9889-4219-b411-7cef1e7370d0 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7584fa42-9889-4219-b411-7cef1e7370d0 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7584fa42-9889-4219-b411-7cef1e7370d0 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7584fa42-9889-4219-b411-7cef1e7370d0 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7584fa42-9889-4219-b411-7cef1e7370d0 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:43 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-7584fa42-9889-4219-b411-7cef1e7370d0 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:34:43 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-7584fa42-9889-4219-b411-7cef1e7370d0 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 200 len: 1722 microversion: 2.1 time: 0.498213 Apr 12 00:34:43 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 114/346] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:34:43 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 1722 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:34:58 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:34:58 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=16,nova_cell1:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:34:58 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-2e5ddb6d-8762-4ce9-9696-377e61b69016 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Action: 'create', calling method: .version_select at 0x7f7cd4912560>, body: {"keypair": {"name": "tempest-keypair-1911302712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwrW/DiMlNF2Ji9Y5iVEQBZtMtRV6Vih4ujw06H39HRo0xW45aPYpYvBV2mUrxJyYo0WpGsoBY7+Fdvab4BKf8lv/2VL0+lT0QPJ8oA5k9l0pJvB0di4++LeVyMOVzPdg=="}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:34:58 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-2e5ddb6d-8762-4ce9-9696-377e61b69016 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Getting quotas for project a8c1003f0d1847b7b4c679b0f7cc3110. Resources: {'key_pairs'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:34:58 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-2e5ddb6d-8762-4ce9-9696-377e61b69016 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Getting quotas for user c276268b63084515a43caa837af30fb1 and project a8c1003f0d1847b7b4c679b0f7cc3110. Resources: {'key_pairs'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:34:58 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-2e5ddb6d-8762-4ce9-9696-377e61b69016 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.338228 Apr 12 00:34:58 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 119/347] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 00:34:58 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:34:59 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-87f86f0d-530b-4850-9588-69062462b702 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:59 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-87f86f0d-530b-4850-9588-69062462b702 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:34:59 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=11 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:34:59 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=21 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:34:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-87f86f0d-530b-4850-9588-69062462b702 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-87f86f0d-530b-4850-9588-69062462b702 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-87f86f0d-530b-4850-9588-69062462b702 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-87f86f0d-530b-4850-9588-69062462b702 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-87f86f0d-530b-4850-9588-69062462b702 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-87f86f0d-530b-4850-9588-69062462b702 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:59 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-af8bd833-889c-43a2-8e20-1033bc794405 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:34:59 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-af8bd833-889c-43a2-8e20-1033bc794405 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:34:59 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=11 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:34:59 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:34:59 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-af8bd833-889c-43a2-8e20-1033bc794405 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:59 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-af8bd833-889c-43a2-8e20-1033bc794405 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:59 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-af8bd833-889c-43a2-8e20-1033bc794405 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:34:59 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-af8bd833-889c-43a2-8e20-1033bc794405 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:34:59 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-af8bd833-889c-43a2-8e20-1033bc794405 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:34:59 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-af8bd833-889c-43a2-8e20-1033bc794405 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:00 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-af8bd833-889c-43a2-8e20-1033bc794405 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373f582479c441e8ce9849ca694a186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f3c567dc84773a33d596920df727a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:35:00 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-af8bd833-889c-43a2-8e20-1033bc794405 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a" status: 200 len: 1546 microversion: 2.1 time: 0.284966 Apr 12 00:35:00 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 115/348] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:34:59 2023] GET /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a => generated 1546 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:35:00 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-87f86f0d-530b-4850-9588-69062462b702 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e843a45549943cb88b1b3123a2fbe8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0ea21a2d4d400cba79444c68b58aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:35:00 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-87f86f0d-530b-4850-9588-69062462b702 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c1ae397-d28d-4143-9aa1-cf00e799f9b5" status: 200 len: 1537 microversion: 2.1 time: 0.325082 Apr 12 00:35:00 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 115/349] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:34:59 2023] GET /compute/v2.1/servers/6c1ae397-d28d-4143-9aa1-cf00e799f9b5 => generated 1537 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:35:00 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-514180225", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "networks": [{"uuid": "d97ca114-f9d6-4141-b129-1e4f8d50b538"}], "security_groups": [{"name": "tempest-securitygroup--463250824"}], "key_name": "tempest-keypair-1911302712", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:35:00 user devstack@n-api.service[72496]: DEBUG nova.network.neutron [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] validate_networks() for [('d97ca114-f9d6-4141-b129-1e4f8d50b538', None, None, None, None, None)] {{(pid=72496) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:35:00 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Flavor limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:35:00 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Image limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:35:00 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Flavor pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:35:00 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Image pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:35:00 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:35:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:01 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:01 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:01 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Getting quotas for project a8c1003f0d1847b7b4c679b0f7cc3110. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:35:01 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Getting quotas for user c276268b63084515a43caa837af30fb1 and project a8c1003f0d1847b7b4c679b0f7cc3110. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:35:01 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Going to run 1 instances... {{(pid=72496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:35:01 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:35:01 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-c3d4e3ee-e952-4a80-8809-2332221fdde0 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.749494 Apr 12 00:35:01 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 120/350] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:35:00 2023] POST /compute/v2.1/servers => generated 403 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:35:01 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-b43c10aa-fb29-4f54-b7a8-658109ff71cc tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:01 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-b43c10aa-fb29-4f54-b7a8-658109ff71cc tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:35:01 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-b43c10aa-fb29-4f54-b7a8-658109ff71cc tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c276268b63084515a43caa837af30fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c1003f0d1847b7b4c679b0f7cc3110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:35:01 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-b43c10aa-fb29-4f54-b7a8-658109ff71cc tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" status: 200 len: 1235 microversion: 2.1 time: 0.065494 Apr 12 00:35:01 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 116/351] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:35:01 2023] GET /compute/v2.1/servers/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 => generated 1235 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:35:04 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-a6a3eb34-f357-41d7-8094-277ccb1aaf68 req-d7df8c29-8cc9-42bc-b632-ea8411677e87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3", "tag": "40e300fb-a2c9-4770-8eee-d1b48baedf34"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:35:04 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a6a3eb34-f357-41d7-8094-277ccb1aaf68 req-d7df8c29-8cc9-42bc-b632-ea8411677e87 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:04 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a6a3eb34-f357-41d7-8094-277ccb1aaf68 req-d7df8c29-8cc9-42bc-b632-ea8411677e87 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:04 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a6a3eb34-f357-41d7-8094-277ccb1aaf68 req-d7df8c29-8cc9-42bc-b632-ea8411677e87 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:04 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-a6a3eb34-f357-41d7-8094-277ccb1aaf68 req-d7df8c29-8cc9-42bc-b632-ea8411677e87 service nova] Creating event network-changed:40e300fb-a2c9-4770-8eee-d1b48baedf34 for instance 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 on user Apr 12 00:35:04 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-a6a3eb34-f357-41d7-8094-277ccb1aaf68 req-d7df8c29-8cc9-42bc-b632-ea8411677e87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089833 Apr 12 00:35:04 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 116/352] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:35:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:35:06 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-81536e9e-b1d7-4896-9a9d-72a0b453f5d6 req-38ee209c-83c6-4582-8cf8-d0eba6240e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3", "name": "network-vif-plugged", "status": "completed", "tag": "40e300fb-a2c9-4770-8eee-d1b48baedf34"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:35:06 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-81536e9e-b1d7-4896-9a9d-72a0b453f5d6 req-38ee209c-83c6-4582-8cf8-d0eba6240e42 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:06 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-81536e9e-b1d7-4896-9a9d-72a0b453f5d6 req-38ee209c-83c6-4582-8cf8-d0eba6240e42 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:06 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-81536e9e-b1d7-4896-9a9d-72a0b453f5d6 req-38ee209c-83c6-4582-8cf8-d0eba6240e42 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:06 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-81536e9e-b1d7-4896-9a9d-72a0b453f5d6 req-38ee209c-83c6-4582-8cf8-d0eba6240e42 service nova] Creating event network-vif-plugged:40e300fb-a2c9-4770-8eee-d1b48baedf34 for instance 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 on user Apr 12 00:35:06 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-81536e9e-b1d7-4896-9a9d-72a0b453f5d6 req-38ee209c-83c6-4582-8cf8-d0eba6240e42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096128 Apr 12 00:35:06 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 121/353] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:35:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:35:07 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-80968c92-2d2f-48bc-b1df-ab680ab96382 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:07 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-80968c92-2d2f-48bc-b1df-ab680ab96382 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:35:07 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-80968c92-2d2f-48bc-b1df-ab680ab96382 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:07 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-80968c92-2d2f-48bc-b1df-ab680ab96382 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:07 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-80968c92-2d2f-48bc-b1df-ab680ab96382 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:07 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-80968c92-2d2f-48bc-b1df-ab680ab96382 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:07 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-80968c92-2d2f-48bc-b1df-ab680ab96382 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:07 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-80968c92-2d2f-48bc-b1df-ab680ab96382 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:07 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-80968c92-2d2f-48bc-b1df-ab680ab96382 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d875a6e14446469a8a58b97a0e89d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48be6d35ad6c43c8b048811baffb8da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:35:07 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-80968c92-2d2f-48bc-b1df-ab680ab96382 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b203e2e-a2ba-4989-94bc-2a78491a9b89" status: 200 len: 1487 microversion: 2.1 time: 0.143995 Apr 12 00:35:07 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 117/354] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:35:07 2023] GET /compute/v2.1/servers/1b203e2e-a2ba-4989-94bc-2a78491a9b89 => generated 1487 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:35:08 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-72fcf1fe-7e45-4664-813d-3847316e2c92 req-63236b1a-e6f3-4527-9208-cb30075aac28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3", "name": "network-vif-plugged", "status": "completed", "tag": "40e300fb-a2c9-4770-8eee-d1b48baedf34"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:35:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-72fcf1fe-7e45-4664-813d-3847316e2c92 req-63236b1a-e6f3-4527-9208-cb30075aac28 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-72fcf1fe-7e45-4664-813d-3847316e2c92 req-63236b1a-e6f3-4527-9208-cb30075aac28 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-72fcf1fe-7e45-4664-813d-3847316e2c92 req-63236b1a-e6f3-4527-9208-cb30075aac28 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:08 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-72fcf1fe-7e45-4664-813d-3847316e2c92 req-63236b1a-e6f3-4527-9208-cb30075aac28 service nova] Creating event network-vif-plugged:40e300fb-a2c9-4770-8eee-d1b48baedf34 for instance 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 on user Apr 12 00:35:08 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-72fcf1fe-7e45-4664-813d-3847316e2c92 req-63236b1a-e6f3-4527-9208-cb30075aac28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032698 Apr 12 00:35:08 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 117/355] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:35:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:35:11 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:35:11 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=10 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:35:11 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:35:11 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:35:11 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:11 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:11 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:11 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:11 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:11 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:11 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=72496) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 12 00:35:11 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-11c759d6-0691-4e00-9b07-bf06478bb0c6 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] 10.0.0.210 "POST /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff/action" status: 202 len: 0 microversion: 2.1 time: 0.135705 Apr 12 00:35:11 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 122/356] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 00:35:11 2023] POST /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:35:11 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-ec394571-0ee8-4ab9-b618-75ec6f29ceea tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:11 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-ec394571-0ee8-4ab9-b618-75ec6f29ceea tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:35:11 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:35:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ec394571-0ee8-4ab9-b618-75ec6f29ceea tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ec394571-0ee8-4ab9-b618-75ec6f29ceea tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ec394571-0ee8-4ab9-b618-75ec6f29ceea tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ec394571-0ee8-4ab9-b618-75ec6f29ceea tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ec394571-0ee8-4ab9-b618-75ec6f29ceea tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ec394571-0ee8-4ab9-b618-75ec6f29ceea tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:11 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-ec394571-0ee8-4ab9-b618-75ec6f29ceea tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391e2cd0c34b4e838c4cf86ba933270c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bc7149e49343889c32fc198b6a0500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:35:11 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-ec394571-0ee8-4ab9-b618-75ec6f29ceea tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff" status: 200 len: 1505 microversion: 2.1 time: 0.186044 Apr 12 00:35:11 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 118/357] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:35:11 2023] GET /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff => generated 1505 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:35:18 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-5ed21b5c-5d8c-4735-8972-aac2a6a2b362 req-39cf105a-8f03-484c-abfd-441491027a0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19cc71e1-9b01-4bfd-9898-14b04bfe5fff", "tag": "b796ef8b-d964-459f-b12c-9be0133dd643"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:35:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-5ed21b5c-5d8c-4735-8972-aac2a6a2b362 req-39cf105a-8f03-484c-abfd-441491027a0d service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-5ed21b5c-5d8c-4735-8972-aac2a6a2b362 req-39cf105a-8f03-484c-abfd-441491027a0d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-5ed21b5c-5d8c-4735-8972-aac2a6a2b362 req-39cf105a-8f03-484c-abfd-441491027a0d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:18 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-5ed21b5c-5d8c-4735-8972-aac2a6a2b362 req-39cf105a-8f03-484c-abfd-441491027a0d service nova] Creating event network-changed:b796ef8b-d964-459f-b12c-9be0133dd643 for instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff on user Apr 12 00:35:18 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-5ed21b5c-5d8c-4735-8972-aac2a6a2b362 req-39cf105a-8f03-484c-abfd-441491027a0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035767 Apr 12 00:35:18 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 118/358] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:35:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:35:18 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-fdb55676-0f5b-4a8b-94af-16f46dbce81b tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-60064192", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "61821624-ce39-491e-91d4-00fcafddbf63", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "4588d0e1-772f-4c76-b467-7e46031e477d"}]}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:35:18 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-fdb55676-0f5b-4a8b-94af-16f46dbce81b tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] HTTP exception thrown: Block Device 61821624-ce39-491e-91d4-00fcafddbf63 is not bootable. Apr 12 00:35:18 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-fdb55676-0f5b-4a8b-94af-16f46dbce81b tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Request method failure captured: Apr 12 00:35:18 user devstack@n-api.service[72496]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 12 00:35:18 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:35:18 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:35:18 user devstack@n-api.service[72496]: Connection: close Apr 12 00:35:18 user devstack@n-api.service[72496]: Content-Length: 355 Apr 12 00:35:18 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:35:18 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:35:18 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:35:18 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:35:18 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNft1qKkmjD8Nll-qUgF19N1LJeB8PdcRbdn5Uq6buO7cPBS5Ov8OoI4tZ5vt-jvCknrLUCUXFnwniWtwxerLQ3Ye5xXh85fQ6mUUIOhguVUuxf5ZIys8tRE0XamxX86aNJtrX6fu_BHxUNtwTPq_PEt8q2KNpjT1y3XmuQXDJ2yaqus Apr 12 00:35:18 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:35:18 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:35:18 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:35:18 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:35:18 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:35:18 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:35:18 user devstack@n-api.service[72496]: X-Project-Id: 6ee31cdc6f4e4c2b9a8ec1e1c5076010 Apr 12 00:35:18 user devstack@n-api.service[72496]: X-Project-Name: tempest-ServersNegativeTestJSON-103053763 Apr 12 00:35:18 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:35:18 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:35:18 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ee31cdc6f4e4c2b9a8ec1e1c5076010"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6ee31cdc6f4e4c2b9a8ec1e1c5076010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ee31cdc6f4e4c2b9a8ec1e1c5076010"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:35:18 user devstack@n-api.service[72496]: X-Tenant: tempest-ServersNegativeTestJSON-103053763 Apr 12 00:35:18 user devstack@n-api.service[72496]: X-Tenant-Id: 6ee31cdc6f4e4c2b9a8ec1e1c5076010 Apr 12 00:35:18 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-ServersNegativeTestJSON-103053763 Apr 12 00:35:18 user devstack@n-api.service[72496]: X-User: tempest-ServersNegativeTestJSON-103053763-project-member Apr 12 00:35:18 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:35:18 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:35:18 user devstack@n-api.service[72496]: X-User-Id: 920d6d79e38e45fcb5153e712605764f Apr 12 00:35:18 user devstack@n-api.service[72496]: X-User-Name: tempest-ServersNegativeTestJSON-103053763-project-member Apr 12 00:35:18 user devstack@n-api.service[72496]: Apr 12 00:35:18 user devstack@n-api.service[72496]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-60064192", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "61821624-ce39-491e-91d4-00fcafddbf63", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "4588d0e1-772f-4c76-b467-7e46031e477d"}]}} Apr 12 00:35:18 user devstack@n-api.service[72496]: method: > Apr 12 00:35:18 user devstack@n-api.service[72496]: exception: Block Device 61821624-ce39-491e-91d4-00fcafddbf63 is not bootable. Apr 12 00:35:18 user devstack@n-api.service[72496]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-60064192', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '61821624-ce39-491e-91d4-00fcafddbf63'}], 'networks': [{'uuid': '4588d0e1-772f-4c76-b467-7e46031e477d'}]}}} Apr 12 00:35:18 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 61821624-ce39-491e-91d4-00fcafddbf63 is not bootable. Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 61821624-ce39-491e-91d4-00fcafddbf63 is not bootable. Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 61821624-ce39-491e-91d4-00fcafddbf63 is not bootable. Apr 12 00:35:18 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:35:18 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-fdb55676-0f5b-4a8b-94af-16f46dbce81b tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Returning 400 to user: Block Device 61821624-ce39-491e-91d4-00fcafddbf63 is not bootable. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:35:18 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-fdb55676-0f5b-4a8b-94af-16f46dbce81b tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.090498 Apr 12 00:35:18 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 123/359] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:35:18 2023] POST /compute/v2.1/servers => generated 110 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:35:18 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-7990ba1b-70f3-4495-a5c0-01b39c42a847 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:18 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-7990ba1b-70f3-4495-a5c0-01b39c42a847 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:35:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7990ba1b-70f3-4495-a5c0-01b39c42a847 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7990ba1b-70f3-4495-a5c0-01b39c42a847 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7990ba1b-70f3-4495-a5c0-01b39c42a847 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7990ba1b-70f3-4495-a5c0-01b39c42a847 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7990ba1b-70f3-4495-a5c0-01b39c42a847 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7990ba1b-70f3-4495-a5c0-01b39c42a847 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:19 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-7990ba1b-70f3-4495-a5c0-01b39c42a847 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920d6d79e38e45fcb5153e712605764f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee31cdc6f4e4c2b9a8ec1e1c5076010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:35:19 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-7990ba1b-70f3-4495-a5c0-01b39c42a847 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" status: 200 len: 1493 microversion: 2.1 time: 0.165423 Apr 12 00:35:19 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 119/360] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:35:18 2023] GET /compute/v2.1/servers/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 => generated 1493 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:35:20 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-8d551dfd-83bb-4948-991a-9dbfb8827321 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:20 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-8d551dfd-83bb-4948-991a-9dbfb8827321 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:35:20 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8d551dfd-83bb-4948-991a-9dbfb8827321 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:20 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8d551dfd-83bb-4948-991a-9dbfb8827321 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:20 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8d551dfd-83bb-4948-991a-9dbfb8827321 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:20 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8d551dfd-83bb-4948-991a-9dbfb8827321 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:20 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8d551dfd-83bb-4948-991a-9dbfb8827321 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:20 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8d551dfd-83bb-4948-991a-9dbfb8827321 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:20 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-8d551dfd-83bb-4948-991a-9dbfb8827321 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042884 Apr 12 00:35:20 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 119/361] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:35:20 2023] GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:35:22 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:35:22 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-38f9879e-0fa1-4277-bcf3-b58392dd7f17 req-b7371349-4b07-428f-a9bd-724fe74d08d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19cc71e1-9b01-4bfd-9898-14b04bfe5fff", "name": "network-vif-plugged", "status": "completed", "tag": "b796ef8b-d964-459f-b12c-9be0133dd643"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:35:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-38f9879e-0fa1-4277-bcf3-b58392dd7f17 req-b7371349-4b07-428f-a9bd-724fe74d08d2 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-38f9879e-0fa1-4277-bcf3-b58392dd7f17 req-b7371349-4b07-428f-a9bd-724fe74d08d2 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-38f9879e-0fa1-4277-bcf3-b58392dd7f17 req-b7371349-4b07-428f-a9bd-724fe74d08d2 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:22 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-38f9879e-0fa1-4277-bcf3-b58392dd7f17 req-b7371349-4b07-428f-a9bd-724fe74d08d2 service nova] Creating event network-vif-plugged:b796ef8b-d964-459f-b12c-9be0133dd643 for instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff on user Apr 12 00:35:22 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-38f9879e-0fa1-4277-bcf3-b58392dd7f17 req-b7371349-4b07-428f-a9bd-724fe74d08d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180603 Apr 12 00:35:22 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 124/362] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:35:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:35:22 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b251160-965f-41ea-9dae-a97c44d4a1db"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:35:22 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:35:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:23 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-b27adfab-a196-4310-9cfe-4ebd3507a56f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.421222 Apr 12 00:35:23 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 120/363] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 00:35:22 2023] POST /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:35:23 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-0859b56d-c35e-44fc-b5a9-b8d56bbe4185 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:23 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-0859b56d-c35e-44fc-b5a9-b8d56bbe4185 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:35:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-0859b56d-c35e-44fc-b5a9-b8d56bbe4185 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-0859b56d-c35e-44fc-b5a9-b8d56bbe4185 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-0859b56d-c35e-44fc-b5a9-b8d56bbe4185 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-0859b56d-c35e-44fc-b5a9-b8d56bbe4185 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-0859b56d-c35e-44fc-b5a9-b8d56bbe4185 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-0859b56d-c35e-44fc-b5a9-b8d56bbe4185 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:24 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-0859b56d-c35e-44fc-b5a9-b8d56bbe4185 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9421443b2f421298a934122c6a8b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf1fea74ef143e6b394e41e7c4ed495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:35:24 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-0859b56d-c35e-44fc-b5a9-b8d56bbe4185 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0" status: 200 len: 1489 microversion: 2.1 time: 0.325174 Apr 12 00:35:24 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 120/364] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:35:23 2023] GET /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0 => generated 1489 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:35:24 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-e53b8255-bd40-4e7c-9696-8bfbddf01b08 req-00411d8c-70c3-44a3-a21d-97e5f6ead95d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19cc71e1-9b01-4bfd-9898-14b04bfe5fff", "name": "network-vif-plugged", "status": "completed", "tag": "b796ef8b-d964-459f-b12c-9be0133dd643"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:35:24 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-e53b8255-bd40-4e7c-9696-8bfbddf01b08 req-00411d8c-70c3-44a3-a21d-97e5f6ead95d service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:24 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-e53b8255-bd40-4e7c-9696-8bfbddf01b08 req-00411d8c-70c3-44a3-a21d-97e5f6ead95d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:24 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-e53b8255-bd40-4e7c-9696-8bfbddf01b08 req-00411d8c-70c3-44a3-a21d-97e5f6ead95d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:24 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-e53b8255-bd40-4e7c-9696-8bfbddf01b08 req-00411d8c-70c3-44a3-a21d-97e5f6ead95d service nova] Creating event network-vif-plugged:b796ef8b-d964-459f-b12c-9be0133dd643 for instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff on user Apr 12 00:35:24 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-e53b8255-bd40-4e7c-9696-8bfbddf01b08 req-00411d8c-70c3-44a3-a21d-97e5f6ead95d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032175 Apr 12 00:35:24 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 125/365] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:35:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:35:31 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:31 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:35:31 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=15 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:35:31 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:31 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:31 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:31 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:31 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:31 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:31 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:35:31 user devstack@n-api.service[72494]: DEBUG nova.objects.instance [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lazy-loading 'services' on Instance uuid 9d67708d-1bcf-4d32-8d45-22376ec72e34 {{(pid=72494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:35:31 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-039daf7c-4a25-4ba4-af86-c241391c654f tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments/5b251160-965f-41ea-9dae-a97c44d4a1db" status: 202 len: 0 microversion: 2.1 time: 0.230091 Apr 12 00:35:31 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 121/366] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 00:35:31 2023] DELETE /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments/5b251160-965f-41ea-9dae-a97c44d4a1db => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:35:31 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-699674262"}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:35:31 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-85f27ff5-f650-4e77-9286-d6a83beafd42 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:31 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:35:31 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-85f27ff5-f650-4e77-9286-d6a83beafd42 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:35:31 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:35:31 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=13 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:35:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-85f27ff5-f650-4e77-9286-d6a83beafd42 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-85f27ff5-f650-4e77-9286-d6a83beafd42 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-85f27ff5-f650-4e77-9286-d6a83beafd42 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-85f27ff5-f650-4e77-9286-d6a83beafd42 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-85f27ff5-f650-4e77-9286-d6a83beafd42 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-85f27ff5-f650-4e77-9286-d6a83beafd42 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:31 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=25 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:35:31 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-85f27ff5-f650-4e77-9286-d6a83beafd42 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075703 Apr 12 00:35:31 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 126/367] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:35:31 2023] GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:35:32 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-8df2b7fc-549c-49d6-b3a2-0c4f16b10919 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/action" status: 202 len: 52 microversion: 2.87 time: 0.976392 Apr 12 00:35:32 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 121/368] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 00:35:31 2023] POST /compute/v2.1/servers/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88/action => generated 52 bytes in 978 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 12 00:35:37 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-338fbe16-74b2-4187-bcce-22110da6792a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:37 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-338fbe16-74b2-4187-bcce-22110da6792a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:35:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-338fbe16-74b2-4187-bcce-22110da6792a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-338fbe16-74b2-4187-bcce-22110da6792a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-338fbe16-74b2-4187-bcce-22110da6792a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-338fbe16-74b2-4187-bcce-22110da6792a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-338fbe16-74b2-4187-bcce-22110da6792a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-338fbe16-74b2-4187-bcce-22110da6792a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:38 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-338fbe16-74b2-4187-bcce-22110da6792a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:35:38 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-338fbe16-74b2-4187-bcce-22110da6792a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:35:38 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-338fbe16-74b2-4187-bcce-22110da6792a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:35:38 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-338fbe16-74b2-4187-bcce-22110da6792a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" status: 200 len: 1692 microversion: 2.87 time: 0.205700 Apr 12 00:35:38 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 122/369] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:35:37 2023] GET /compute/v2.1/servers/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 => generated 1692 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:35:40 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-a4300134-868d-4afa-87f2-bf6dbc4260b3 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:40 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-a4300134-868d-4afa-87f2-bf6dbc4260b3 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:35:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a4300134-868d-4afa-87f2-bf6dbc4260b3 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a4300134-868d-4afa-87f2-bf6dbc4260b3 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a4300134-868d-4afa-87f2-bf6dbc4260b3 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a4300134-868d-4afa-87f2-bf6dbc4260b3 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a4300134-868d-4afa-87f2-bf6dbc4260b3 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a4300134-868d-4afa-87f2-bf6dbc4260b3 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:41 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-a4300134-868d-4afa-87f2-bf6dbc4260b3 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:35:41 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-a4300134-868d-4afa-87f2-bf6dbc4260b3 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8833bad-d30f-4cd4-aa66-10d60c782061" status: 200 len: 1391 microversion: 2.1 time: 0.158763 Apr 12 00:35:41 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 127/370] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:35:40 2023] GET /compute/v2.1/servers/d8833bad-d30f-4cd4-aa66-10d60c782061 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:35:41 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-e94c416a-609b-4af8-8b3f-564f160b7cee tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-216687367"}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:35:41 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-e94c416a-609b-4af8-8b3f-564f160b7cee tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:35:41 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e94c416a-609b-4af8-8b3f-564f160b7cee tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:41 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e94c416a-609b-4af8-8b3f-564f160b7cee tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:41 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e94c416a-609b-4af8-8b3f-564f160b7cee tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:41 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e94c416a-609b-4af8-8b3f-564f160b7cee tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:41 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e94c416a-609b-4af8-8b3f-564f160b7cee tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:41 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e94c416a-609b-4af8-8b3f-564f160b7cee tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:41 user devstack@n-api.service[72495]: INFO nova.compute.api [None req-e94c416a-609b-4af8-8b3f-564f160b7cee tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Attempting to quiesce instance before volume snapshot. Apr 12 00:35:41 user devstack@n-api.service[72495]: INFO nova.compute.api [None req-e94c416a-609b-4af8-8b3f-564f160b7cee tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 12 00:35:41 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-e94c416a-609b-4af8-8b3f-564f160b7cee tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Creating snapshot from volume ca06330d-06f4-4f25-8449-2e03b021dc3b. {{(pid=72495) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 12 00:35:43 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-e94c416a-609b-4af8-8b3f-564f160b7cee tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d8833bad-d30f-4cd4-aa66-10d60c782061/action" status: 202 len: 0 microversion: 2.1 time: 2.767391 Apr 12 00:35:43 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 122/371] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 00:35:41 2023] POST /compute/v2.1/servers/d8833bad-d30f-4cd4-aa66-10d60c782061/action => generated 0 bytes in 2769 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 12 00:35:43 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-7b0207f2-05a4-4955-b4bd-84a5a3604931 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:43 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-7b0207f2-05a4-4955-b4bd-84a5a3604931 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:35:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7b0207f2-05a4-4955-b4bd-84a5a3604931 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7b0207f2-05a4-4955-b4bd-84a5a3604931 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7b0207f2-05a4-4955-b4bd-84a5a3604931 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7b0207f2-05a4-4955-b4bd-84a5a3604931 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7b0207f2-05a4-4955-b4bd-84a5a3604931 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7b0207f2-05a4-4955-b4bd-84a5a3604931 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:44 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-7b0207f2-05a4-4955-b4bd-84a5a3604931 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:35:44 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-7b0207f2-05a4-4955-b4bd-84a5a3604931 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 200 len: 1722 microversion: 2.1 time: 0.331067 Apr 12 00:35:44 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 123/372] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:35:43 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 1722 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:35:44 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-410164590", "imageRef": "7a7cf27a-f1da-4da9-9e1f-94aab7e25de9", "flavorRef": "42", "networks": [{"uuid": "159bca51-de37-4d87-9af5-ec97816a869c"}]}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:35:44 user devstack@n-api.service[72496]: DEBUG nova.network.neutron [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] validate_networks() for [('159bca51-de37-4d87-9af5-ec97816a869c', None, None, None, None, None)] {{(pid=72496) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:35:44 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-cb09db49-9025-49ac-bd75-90504b81d480 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:44 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-cb09db49-9025-49ac-bd75-90504b81d480 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:35:44 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cb09db49-9025-49ac-bd75-90504b81d480 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:44 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cb09db49-9025-49ac-bd75-90504b81d480 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:44 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cb09db49-9025-49ac-bd75-90504b81d480 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:44 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cb09db49-9025-49ac-bd75-90504b81d480 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:44 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cb09db49-9025-49ac-bd75-90504b81d480 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:44 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cb09db49-9025-49ac-bd75-90504b81d480 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:44 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-cb09db49-9025-49ac-bd75-90504b81d480 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:35:44 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-cb09db49-9025-49ac-bd75-90504b81d480 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 200 len: 1722 microversion: 2.1 time: 0.230003 Apr 12 00:35:44 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 123/373] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:35:44 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:35:44 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flavor limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:35:44 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Image limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:35:44 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flavor pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:35:44 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Image pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:35:44 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:35:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:44 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting quotas for project e38a98bf1d964ee6bd2d0d05e97a283a. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:35:44 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting quotas for user c479f6ae2f0d40908be9b07717ca3509 and project e38a98bf1d964ee6bd2d0d05e97a283a. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:35:44 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Going to run 1 instances... {{(pid=72496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:35:44 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='5353d58f-cef2-4d6a-b87d-8f61ee082357',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=72496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:35:44 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-6362846f-8042-4266-b90a-95b754df9838 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.575999 Apr 12 00:35:44 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 128/374] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:35:44 2023] POST /compute/v2.1/servers => generated 378 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:35:44 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-3b9cead9-0a04-44d3-b26c-bd85a68debdb tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:44 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-3b9cead9-0a04-44d3-b26c-bd85a68debdb tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:35:44 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-3b9cead9-0a04-44d3-b26c-bd85a68debdb tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:35:44 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-3b9cead9-0a04-44d3-b26c-bd85a68debdb tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ba310127-67a9-4245-87f6-555e35f30a16" status: 200 len: 1223 microversion: 2.1 time: 0.065702 Apr 12 00:35:44 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 124/375] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:35:44 2023] GET /compute/v2.1/servers/ba310127-67a9-4245-87f6-555e35f30a16 => generated 1223 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:35:47 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-0e80b72d-45a5-4a19-99fb-8cb56075e7a7 req-57bdfec3-c656-4b76-8f2a-3df6993f72e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba310127-67a9-4245-87f6-555e35f30a16", "tag": "903dfac0-8003-4008-b135-5da44763c9ff"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:35:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-0e80b72d-45a5-4a19-99fb-8cb56075e7a7 req-57bdfec3-c656-4b76-8f2a-3df6993f72e0 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-0e80b72d-45a5-4a19-99fb-8cb56075e7a7 req-57bdfec3-c656-4b76-8f2a-3df6993f72e0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-0e80b72d-45a5-4a19-99fb-8cb56075e7a7 req-57bdfec3-c656-4b76-8f2a-3df6993f72e0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:47 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-0e80b72d-45a5-4a19-99fb-8cb56075e7a7 req-57bdfec3-c656-4b76-8f2a-3df6993f72e0 service nova] Creating event network-changed:903dfac0-8003-4008-b135-5da44763c9ff for instance ba310127-67a9-4245-87f6-555e35f30a16 on user Apr 12 00:35:47 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-0e80b72d-45a5-4a19-99fb-8cb56075e7a7 req-57bdfec3-c656-4b76-8f2a-3df6993f72e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036249 Apr 12 00:35:47 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 124/376] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:35:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:35:51 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-a8f0aa62-1640-4f2f-b1c5-3d8d13d82445 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:35:51 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-a8f0aa62-1640-4f2f-b1c5-3d8d13d82445 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:35:51 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a8f0aa62-1640-4f2f-b1c5-3d8d13d82445 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:51 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a8f0aa62-1640-4f2f-b1c5-3d8d13d82445 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:51 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a8f0aa62-1640-4f2f-b1c5-3d8d13d82445 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:51 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a8f0aa62-1640-4f2f-b1c5-3d8d13d82445 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:51 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a8f0aa62-1640-4f2f-b1c5-3d8d13d82445 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:51 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a8f0aa62-1640-4f2f-b1c5-3d8d13d82445 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:51 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-a8f0aa62-1640-4f2f-b1c5-3d8d13d82445 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c276268b63084515a43caa837af30fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c1003f0d1847b7b4c679b0f7cc3110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:35:51 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-a8f0aa62-1640-4f2f-b1c5-3d8d13d82445 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" status: 200 len: 1543 microversion: 2.1 time: 0.140212 Apr 12 00:35:51 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 129/377] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:35:51 2023] GET /compute/v2.1/servers/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 => generated 1543 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:35:59 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-07f5511b-ac09-46f7-b656-467cd8bf40ce req-0c878e3e-eb78-4f26-9051-4a47156c4ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba310127-67a9-4245-87f6-555e35f30a16", "name": "network-vif-plugged", "status": "completed", "tag": "903dfac0-8003-4008-b135-5da44763c9ff"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:35:59 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=20,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:35:59 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=11 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:35:59 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:35:59 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-07f5511b-ac09-46f7-b656-467cd8bf40ce req-0c878e3e-eb78-4f26-9051-4a47156c4ec6 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:35:59 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-07f5511b-ac09-46f7-b656-467cd8bf40ce req-0c878e3e-eb78-4f26-9051-4a47156c4ec6 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:35:59 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-07f5511b-ac09-46f7-b656-467cd8bf40ce req-0c878e3e-eb78-4f26-9051-4a47156c4ec6 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:35:59 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-07f5511b-ac09-46f7-b656-467cd8bf40ce req-0c878e3e-eb78-4f26-9051-4a47156c4ec6 service nova] Creating event network-vif-plugged:903dfac0-8003-4008-b135-5da44763c9ff for instance ba310127-67a9-4245-87f6-555e35f30a16 on user Apr 12 00:35:59 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-07f5511b-ac09-46f7-b656-467cd8bf40ce req-0c878e3e-eb78-4f26-9051-4a47156c4ec6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048431 Apr 12 00:35:59 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 125/378] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:35:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:00 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=7 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:36:00 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:36:00 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-3a91f911-9031-4d0d-acf0-be50a7898f15 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:00 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-3a91f911-9031-4d0d-acf0-be50a7898f15 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:00 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-3a91f911-9031-4d0d-acf0-be50a7898f15 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:00 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-3a91f911-9031-4d0d-acf0-be50a7898f15 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:00 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-3a91f911-9031-4d0d-acf0-be50a7898f15 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:00 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-3a91f911-9031-4d0d-acf0-be50a7898f15 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:00 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-3a91f911-9031-4d0d-acf0-be50a7898f15 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:00 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-3a91f911-9031-4d0d-acf0-be50a7898f15 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:00 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:36:00 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:36:00 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-3a91f911-9031-4d0d-acf0-be50a7898f15 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.097054 Apr 12 00:36:00 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 125/379] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 00:36:00 2023] GET /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/os-interface => generated 282 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:00 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-8194098e-a472-411b-be55-94b6621a8ff5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:00 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-8194098e-a472-411b-be55-94b6621a8ff5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8194098e-a472-411b-be55-94b6621a8ff5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8194098e-a472-411b-be55-94b6621a8ff5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8194098e-a472-411b-be55-94b6621a8ff5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8194098e-a472-411b-be55-94b6621a8ff5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8194098e-a472-411b-be55-94b6621a8ff5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8194098e-a472-411b-be55-94b6621a8ff5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:00 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=25 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:36:00 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-8194098e-a472-411b-be55-94b6621a8ff5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e843a45549943cb88b1b3123a2fbe8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0ea21a2d4d400cba79444c68b58aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:36:00 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-8194098e-a472-411b-be55-94b6621a8ff5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c1ae397-d28d-4143-9aa1-cf00e799f9b5" status: 200 len: 1537 microversion: 2.1 time: 0.264720 Apr 12 00:36:00 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 130/380] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:36:00 2023] GET /compute/v2.1/servers/6c1ae397-d28d-4143-9aa1-cf00e799f9b5 => generated 1537 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:01 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-657f268e-4a48-40d9-a9e7-e80d870ca1c0 req-aba52cd7-ac1f-45ae-be0d-409b2748cc32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bae2f38-fd5e-4d51-be63-22bbf54cd77a", "tag": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-657f268e-4a48-40d9-a9e7-e80d870ca1c0 req-aba52cd7-ac1f-45ae-be0d-409b2748cc32 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-657f268e-4a48-40d9-a9e7-e80d870ca1c0 req-aba52cd7-ac1f-45ae-be0d-409b2748cc32 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-657f268e-4a48-40d9-a9e7-e80d870ca1c0 req-aba52cd7-ac1f-45ae-be0d-409b2748cc32 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:01 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-657f268e-4a48-40d9-a9e7-e80d870ca1c0 req-aba52cd7-ac1f-45ae-be0d-409b2748cc32 service nova] Creating event network-changed:a152413c-fa33-4f4e-8c91-2b8a8c5565b6 for instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a on user Apr 12 00:36:01 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-657f268e-4a48-40d9-a9e7-e80d870ca1c0 req-aba52cd7-ac1f-45ae-be0d-409b2748cc32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041630 Apr 12 00:36:01 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 126/381] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:36:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:01 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-b34d8a16-6525-4d80-95fa-5ae02671e9c6 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:01 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-b34d8a16-6525-4d80-95fa-5ae02671e9c6 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:01 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b34d8a16-6525-4d80-95fa-5ae02671e9c6 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:01 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b34d8a16-6525-4d80-95fa-5ae02671e9c6 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:01 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b34d8a16-6525-4d80-95fa-5ae02671e9c6 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:01 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b34d8a16-6525-4d80-95fa-5ae02671e9c6 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:01 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b34d8a16-6525-4d80-95fa-5ae02671e9c6 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:01 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b34d8a16-6525-4d80-95fa-5ae02671e9c6 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:01 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-b34d8a16-6525-4d80-95fa-5ae02671e9c6 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/ips" status: 200 len: 108 microversion: 2.1 time: 0.039127 Apr 12 00:36:01 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 126/382] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 00:36:01 2023] GET /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/ips => generated 108 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:01 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-4cf3413b-0696-417e-978f-9c6b87a272aa req-d1358377-2b61-4648-8987-8bb6efd06ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba310127-67a9-4245-87f6-555e35f30a16", "name": "network-vif-plugged", "status": "completed", "tag": "903dfac0-8003-4008-b135-5da44763c9ff"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:01 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4cf3413b-0696-417e-978f-9c6b87a272aa req-d1358377-2b61-4648-8987-8bb6efd06ab6 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:01 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4cf3413b-0696-417e-978f-9c6b87a272aa req-d1358377-2b61-4648-8987-8bb6efd06ab6 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:01 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4cf3413b-0696-417e-978f-9c6b87a272aa req-d1358377-2b61-4648-8987-8bb6efd06ab6 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:01 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-4cf3413b-0696-417e-978f-9c6b87a272aa req-d1358377-2b61-4648-8987-8bb6efd06ab6 service nova] Creating event network-vif-plugged:903dfac0-8003-4008-b135-5da44763c9ff for instance ba310127-67a9-4245-87f6-555e35f30a16 on user Apr 12 00:36:01 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-4cf3413b-0696-417e-978f-9c6b87a272aa req-d1358377-2b61-4648-8987-8bb6efd06ab6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036285 Apr 12 00:36:01 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 131/383] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:36:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:01 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-e49ebabb-83e5-4ec8-8bf6-6943ed0cafc7 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:01 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-e49ebabb-83e5-4ec8-8bf6-6943ed0cafc7 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e49ebabb-83e5-4ec8-8bf6-6943ed0cafc7 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e49ebabb-83e5-4ec8-8bf6-6943ed0cafc7 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e49ebabb-83e5-4ec8-8bf6-6943ed0cafc7 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e49ebabb-83e5-4ec8-8bf6-6943ed0cafc7 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e49ebabb-83e5-4ec8-8bf6-6943ed0cafc7 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e49ebabb-83e5-4ec8-8bf6-6943ed0cafc7 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:02 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-e49ebabb-83e5-4ec8-8bf6-6943ed0cafc7 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391e2cd0c34b4e838c4cf86ba933270c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bc7149e49343889c32fc198b6a0500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:36:02 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-e49ebabb-83e5-4ec8-8bf6-6943ed0cafc7 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff" status: 200 len: 1550 microversion: 2.1 time: 0.397216 Apr 12 00:36:02 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 127/384] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:36:01 2023] GET /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff => generated 1550 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:02 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-270e694f-135c-423e-829e-7c29fe788117 req-f93e1c97-9f97-41b7-8aca-7b5b19f25503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c1ae397-d28d-4143-9aa1-cf00e799f9b5", "tag": "f0e98861-35b6-489e-9f17-463054e69601"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:02 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-270e694f-135c-423e-829e-7c29fe788117 req-f93e1c97-9f97-41b7-8aca-7b5b19f25503 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:02 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-270e694f-135c-423e-829e-7c29fe788117 req-f93e1c97-9f97-41b7-8aca-7b5b19f25503 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:02 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-270e694f-135c-423e-829e-7c29fe788117 req-f93e1c97-9f97-41b7-8aca-7b5b19f25503 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:02 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-270e694f-135c-423e-829e-7c29fe788117 req-f93e1c97-9f97-41b7-8aca-7b5b19f25503 service nova] Creating event network-changed:f0e98861-35b6-489e-9f17-463054e69601 for instance 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 on user Apr 12 00:36:02 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-270e694f-135c-423e-829e-7c29fe788117 req-f93e1c97-9f97-41b7-8aca-7b5b19f25503 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030837 Apr 12 00:36:02 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 127/385] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:36:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:02 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b3f208d-e481-472f-8547-dd689d9f336a"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:02 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:02 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:36:02 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:02 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:02 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:02 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:02 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:02 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:02 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04e2cfac-63fa-480c-a8bd-f583809971ab"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:02 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:02 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:02 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:02 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:02 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:02 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:02 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:02 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-22120120-9d7b-4035-9068-f1fbfa9dfe5c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326361 Apr 12 00:36:02 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 128/386] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 00:36:02 2023] POST /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:02 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-c4158bc5-a9b3-48f8-9bc3-32f0f80ef257 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381114 Apr 12 00:36:02 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 132/387] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 00:36:02 2023] POST /compute/v2.1/servers/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/os-volume_attachments => generated 194 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:12 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:36:12 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=10 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:36:12 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-f9e69d31-a5f5-489d-931f-23dbf084bf98 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Action: 'create', calling method: .version_select at 0x7f7cd4767e20>, body: {"keypair": {"name": "tempest-keypair-665321536", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHLuxBkm6l01yjTwTdI1oiZ9aYwN/CnkMAfV6gxx8VJgA1NcUdSBeVuPz9wX3aWjmvtFSrqyDF/6dJS/nZiFNgFQ/beyg+GrmUzZrVy2Dcklya2DeprEvo0CkCYCFDqXA=="}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:12 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-f9e69d31-a5f5-489d-931f-23dbf084bf98 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Getting quotas for project b56f3c567dc84773a33d596920df727a. Resources: {'key_pairs'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:36:12 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-f9e69d31-a5f5-489d-931f-23dbf084bf98 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Getting quotas for user d373f582479c441e8ce9849ca694a186 and project b56f3c567dc84773a33d596920df727a. Resources: {'key_pairs'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:36:12 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-f9e69d31-a5f5-489d-931f-23dbf084bf98 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062828 Apr 12 00:36:12 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 128/388] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 00:36:12 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:13 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=8 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:36:13 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:36:13 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:13 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:13 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:13 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:13 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:13 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:13 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:13 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:13 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Going to try to terminate instance {{(pid=72494) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:36:13 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-f94a5431-8473-4d72-85ac-f0c87632bcd3 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1b203e2e-a2ba-4989-94bc-2a78491a9b89" status: 204 len: 0 microversion: 2.1 time: 0.192730 Apr 12 00:36:13 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 129/389] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:36:13 2023] DELETE /compute/v2.1/servers/1b203e2e-a2ba-4989-94bc-2a78491a9b89 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:36:13 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:36:13 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:36:13 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-a3a42974-1d4f-43ec-bff3-c1c75a8226cd tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:13 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-a3a42974-1d4f-43ec-bff3-c1c75a8226cd tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:13 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a3a42974-1d4f-43ec-bff3-c1c75a8226cd tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:13 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a3a42974-1d4f-43ec-bff3-c1c75a8226cd tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:13 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a3a42974-1d4f-43ec-bff3-c1c75a8226cd tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:13 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a3a42974-1d4f-43ec-bff3-c1c75a8226cd tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:13 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a3a42974-1d4f-43ec-bff3-c1c75a8226cd tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:13 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a3a42974-1d4f-43ec-bff3-c1c75a8226cd tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:13 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-a3a42974-1d4f-43ec-bff3-c1c75a8226cd tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d875a6e14446469a8a58b97a0e89d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48be6d35ad6c43c8b048811baffb8da8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:36:13 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-a3a42974-1d4f-43ec-bff3-c1c75a8226cd tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b203e2e-a2ba-4989-94bc-2a78491a9b89" status: 200 len: 1493 microversion: 2.1 time: 0.203701 Apr 12 00:36:13 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 133/390] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:36:13 2023] GET /compute/v2.1/servers/1b203e2e-a2ba-4989-94bc-2a78491a9b89 => generated 1493 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:13 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-55aa4198-bca2-48a0-b94e-aa1385a394e0 req-e4051018-6619-4c84-ab15-f2dee423f816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b203e2e-a2ba-4989-94bc-2a78491a9b89", "name": "network-vif-unplugged", "status": "completed", "tag": "857280d0-efc9-4f7f-988a-ca07d7d5f957"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:13 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-55aa4198-bca2-48a0-b94e-aa1385a394e0 req-e4051018-6619-4c84-ab15-f2dee423f816 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:13 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-55aa4198-bca2-48a0-b94e-aa1385a394e0 req-e4051018-6619-4c84-ab15-f2dee423f816 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:13 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-55aa4198-bca2-48a0-b94e-aa1385a394e0 req-e4051018-6619-4c84-ab15-f2dee423f816 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:13 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-55aa4198-bca2-48a0-b94e-aa1385a394e0 req-e4051018-6619-4c84-ab15-f2dee423f816 service nova] Creating event network-vif-unplugged:857280d0-efc9-4f7f-988a-ca07d7d5f957 for instance 1b203e2e-a2ba-4989-94bc-2a78491a9b89 on user Apr 12 00:36:13 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-55aa4198-bca2-48a0-b94e-aa1385a394e0 req-e4051018-6619-4c84-ab15-f2dee423f816 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031937 Apr 12 00:36:13 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 129/391] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:36:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:14 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:14 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:14 user devstack@n-api.service[72494]: DEBUG nova.objects.instance [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lazy-loading 'services' on Instance uuid 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 {{(pid=72494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:36:14 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-f30dbef6-3148-4464-b4e3-f0688ba8218d tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/os-volume_attachments/5b3f208d-e481-472f-8547-dd689d9f336a" status: 202 len: 0 microversion: 2.1 time: 0.258287 Apr 12 00:36:14 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 130/392] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 00:36:14 2023] DELETE /compute/v2.1/servers/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/os-volume_attachments/5b3f208d-e481-472f-8547-dd689d9f336a => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:36:14 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-1e565bbf-f1df-4c29-ba9b-289fa23bc8e6 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:14 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-1e565bbf-f1df-4c29-ba9b-289fa23bc8e6 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:14 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1e565bbf-f1df-4c29-ba9b-289fa23bc8e6 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:14 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1e565bbf-f1df-4c29-ba9b-289fa23bc8e6 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:14 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1e565bbf-f1df-4c29-ba9b-289fa23bc8e6 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:14 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1e565bbf-f1df-4c29-ba9b-289fa23bc8e6 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:14 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1e565bbf-f1df-4c29-ba9b-289fa23bc8e6 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:14 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1e565bbf-f1df-4c29-ba9b-289fa23bc8e6 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:14 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-1e565bbf-f1df-4c29-ba9b-289fa23bc8e6 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045857 Apr 12 00:36:14 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 134/393] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:36:14 2023] GET /compute/v2.1/servers/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:14 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-267379931", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1"}], "security_groups": [{"name": "tempest-securitygroup--1090023103"}], "key_name": "tempest-keypair-665321536", "user_data": "}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:14 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-2e836ddd-4adf-443b-9879-0338dae165aa req-6cc1b7f7-e374-4508-9495-dfa2482924a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b203e2e-a2ba-4989-94bc-2a78491a9b89", "name": "network-vif-deleted", "tag": "857280d0-efc9-4f7f-988a-ca07d7d5f957"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-2e836ddd-4adf-443b-9879-0338dae165aa req-6cc1b7f7-e374-4508-9495-dfa2482924a7 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-2e836ddd-4adf-443b-9879-0338dae165aa req-6cc1b7f7-e374-4508-9495-dfa2482924a7 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-2e836ddd-4adf-443b-9879-0338dae165aa req-6cc1b7f7-e374-4508-9495-dfa2482924a7 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:14 user devstack@n-api.service[72495]: DEBUG nova.network.neutron [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] validate_networks() for [('df248eb3-f39c-4a81-aca0-6c2d01f6d2b1', None, None, None, None, None)] {{(pid=72495) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:36:15 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-2e836ddd-4adf-443b-9879-0338dae165aa req-6cc1b7f7-e374-4508-9495-dfa2482924a7 service nova] Creating event network-vif-deleted:857280d0-efc9-4f7f-988a-ca07d7d5f957 for instance 1b203e2e-a2ba-4989-94bc-2a78491a9b89 on user Apr 12 00:36:15 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-2e836ddd-4adf-443b-9879-0338dae165aa req-6cc1b7f7-e374-4508-9495-dfa2482924a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035371 Apr 12 00:36:15 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 131/394] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:36:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:15 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Flavor limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:36:15 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Image limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:36:15 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Flavor pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:36:15 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Image pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:36:15 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:36:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:15 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Getting quotas for project b56f3c567dc84773a33d596920df727a. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:36:15 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Getting quotas for user d373f582479c441e8ce9849ca694a186 and project b56f3c567dc84773a33d596920df727a. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:36:15 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Going to run 1 instances... {{(pid=72495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:36:15 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:36:15 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-eb666353-047d-4e08-862d-593aa2c205bd tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.666676 Apr 12 00:36:15 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 130/395] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:36:14 2023] POST /compute/v2.1/servers => generated 400 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:36:15 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-448a7456-0671-4bd4-905d-5e270cc9bbd6 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:15 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-448a7456-0671-4bd4-905d-5e270cc9bbd6 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:15 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-448a7456-0671-4bd4-905d-5e270cc9bbd6 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373f582479c441e8ce9849ca694a186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f3c567dc84773a33d596920df727a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:36:15 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-448a7456-0671-4bd4-905d-5e270cc9bbd6 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8fd7bb9c-9e20-49f2-8848-162a784b9885" status: 200 len: 1234 microversion: 2.1 time: 0.067929 Apr 12 00:36:15 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 135/396] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:36:15 2023] GET /compute/v2.1/servers/8fd7bb9c-9e20-49f2-8848-162a784b9885 => generated 1234 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:15 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-1bd33da6-df58-4d45-9b02-88cbb42b3637 req-75226f33-8072-4aef-b584-2f137fdace96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b203e2e-a2ba-4989-94bc-2a78491a9b89", "name": "network-vif-plugged", "status": "completed", "tag": "857280d0-efc9-4f7f-988a-ca07d7d5f957"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:15 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-1bd33da6-df58-4d45-9b02-88cbb42b3637 req-75226f33-8072-4aef-b584-2f137fdace96 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:15 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-1bd33da6-df58-4d45-9b02-88cbb42b3637 req-75226f33-8072-4aef-b584-2f137fdace96 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:15 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-1bd33da6-df58-4d45-9b02-88cbb42b3637 req-75226f33-8072-4aef-b584-2f137fdace96 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:15 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-1bd33da6-df58-4d45-9b02-88cbb42b3637 req-75226f33-8072-4aef-b584-2f137fdace96 service nova] Creating event network-vif-plugged:857280d0-efc9-4f7f-988a-ca07d7d5f957 for instance 1b203e2e-a2ba-4989-94bc-2a78491a9b89 on user Apr 12 00:36:15 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-1bd33da6-df58-4d45-9b02-88cbb42b3637 req-75226f33-8072-4aef-b584-2f137fdace96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032954 Apr 12 00:36:15 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 132/397] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:36:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:18 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-f608832c-0181-42bf-b9df-2c9f779535a5 req-e0e39239-6d10-49f1-9b86-71cd4653e25b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fd7bb9c-9e20-49f2-8848-162a784b9885", "tag": "4e105e43-5ee4-46ca-a01a-be1a58096a0a"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-f608832c-0181-42bf-b9df-2c9f779535a5 req-e0e39239-6d10-49f1-9b86-71cd4653e25b service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-f608832c-0181-42bf-b9df-2c9f779535a5 req-e0e39239-6d10-49f1-9b86-71cd4653e25b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-f608832c-0181-42bf-b9df-2c9f779535a5 req-e0e39239-6d10-49f1-9b86-71cd4653e25b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:18 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-f608832c-0181-42bf-b9df-2c9f779535a5 req-e0e39239-6d10-49f1-9b86-71cd4653e25b service nova] Creating event network-changed:4e105e43-5ee4-46ca-a01a-be1a58096a0a for instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 on user Apr 12 00:36:18 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-f608832c-0181-42bf-b9df-2c9f779535a5 req-e0e39239-6d10-49f1-9b86-71cd4653e25b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030762 Apr 12 00:36:18 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 131/398] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:36:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:19 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-2cb58d85-26a7-4172-8c15-bf0f40f146be tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:19 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-2cb58d85-26a7-4172-8c15-bf0f40f146be tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2cb58d85-26a7-4172-8c15-bf0f40f146be tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2cb58d85-26a7-4172-8c15-bf0f40f146be tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2cb58d85-26a7-4172-8c15-bf0f40f146be tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2cb58d85-26a7-4172-8c15-bf0f40f146be tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2cb58d85-26a7-4172-8c15-bf0f40f146be tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2cb58d85-26a7-4172-8c15-bf0f40f146be tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:19 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-2cb58d85-26a7-4172-8c15-bf0f40f146be tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920d6d79e38e45fcb5153e712605764f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee31cdc6f4e4c2b9a8ec1e1c5076010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:36:19 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-2cb58d85-26a7-4172-8c15-bf0f40f146be tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" status: 200 len: 1493 microversion: 2.1 time: 0.147771 Apr 12 00:36:19 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 136/399] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:36:19 2023] GET /compute/v2.1/servers/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 => generated 1493 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:20 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-d1e6a8bc-6bc1-4494-b8fb-2e2e86cffc36 req-89142916-9739-4110-8a1d-40a582afed87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fd7bb9c-9e20-49f2-8848-162a784b9885", "name": "network-vif-plugged", "status": "completed", "tag": "4e105e43-5ee4-46ca-a01a-be1a58096a0a"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-d1e6a8bc-6bc1-4494-b8fb-2e2e86cffc36 req-89142916-9739-4110-8a1d-40a582afed87 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-d1e6a8bc-6bc1-4494-b8fb-2e2e86cffc36 req-89142916-9739-4110-8a1d-40a582afed87 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-d1e6a8bc-6bc1-4494-b8fb-2e2e86cffc36 req-89142916-9739-4110-8a1d-40a582afed87 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:20 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-d1e6a8bc-6bc1-4494-b8fb-2e2e86cffc36 req-89142916-9739-4110-8a1d-40a582afed87 service nova] Creating event network-vif-plugged:4e105e43-5ee4-46ca-a01a-be1a58096a0a for instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 on user Apr 12 00:36:20 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-d1e6a8bc-6bc1-4494-b8fb-2e2e86cffc36 req-89142916-9739-4110-8a1d-40a582afed87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037897 Apr 12 00:36:20 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 133/400] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:36:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:21 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-9a3226e4-1ffe-4dbb-ba25-146f78487e6c tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:21 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-9a3226e4-1ffe-4dbb-ba25-146f78487e6c tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:22 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9a3226e4-1ffe-4dbb-ba25-146f78487e6c tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:22 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9a3226e4-1ffe-4dbb-ba25-146f78487e6c tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:22 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9a3226e4-1ffe-4dbb-ba25-146f78487e6c tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:22 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9a3226e4-1ffe-4dbb-ba25-146f78487e6c tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:22 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9a3226e4-1ffe-4dbb-ba25-146f78487e6c tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:22 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9a3226e4-1ffe-4dbb-ba25-146f78487e6c tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:22 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-9a3226e4-1ffe-4dbb-ba25-146f78487e6c tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.146663 Apr 12 00:36:22 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 132/401] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:36:21 2023] GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments => generated 25 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:36:22 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-bbdbdb5e-5fb6-42ff-ae30-bc5ad6795c0c req-07c1b46e-c75c-40fb-b723-59c26d4d4a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fd7bb9c-9e20-49f2-8848-162a784b9885", "name": "network-vif-plugged", "status": "completed", "tag": "4e105e43-5ee4-46ca-a01a-be1a58096a0a"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-bbdbdb5e-5fb6-42ff-ae30-bc5ad6795c0c req-07c1b46e-c75c-40fb-b723-59c26d4d4a9a service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-bbdbdb5e-5fb6-42ff-ae30-bc5ad6795c0c req-07c1b46e-c75c-40fb-b723-59c26d4d4a9a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-bbdbdb5e-5fb6-42ff-ae30-bc5ad6795c0c req-07c1b46e-c75c-40fb-b723-59c26d4d4a9a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:22 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-bbdbdb5e-5fb6-42ff-ae30-bc5ad6795c0c req-07c1b46e-c75c-40fb-b723-59c26d4d4a9a service nova] Creating event network-vif-plugged:4e105e43-5ee4-46ca-a01a-be1a58096a0a for instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 on user Apr 12 00:36:22 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-bbdbdb5e-5fb6-42ff-ae30-bc5ad6795c0c req-07c1b46e-c75c-40fb-b723-59c26d4d4a9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030327 Apr 12 00:36:22 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 137/402] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:36:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:24 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-c872804d-efa9-4139-a464-92c726aae3e9 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ad2b2d8-9483-4089-895d-b180c590ebd6"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:24 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-c872804d-efa9-4139-a464-92c726aae3e9 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c872804d-efa9-4139-a464-92c726aae3e9 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c872804d-efa9-4139-a464-92c726aae3e9 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c872804d-efa9-4139-a464-92c726aae3e9 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c872804d-efa9-4139-a464-92c726aae3e9 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c872804d-efa9-4139-a464-92c726aae3e9 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c872804d-efa9-4139-a464-92c726aae3e9 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:24 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-c872804d-efa9-4139-a464-92c726aae3e9 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 while it is in vm_state rescued Apr 12 00:36:24 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-c872804d-efa9-4139-a464-92c726aae3e9 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Request method failure captured: Apr 12 00:36:24 user devstack@n-api.service[72494]: request: POST /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0/os-volume_attachments HTTP/1.1 Apr 12 00:36:24 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:36:24 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:36:24 user devstack@n-api.service[72494]: Connection: close Apr 12 00:36:24 user devstack@n-api.service[72494]: Content-Length: 74 Apr 12 00:36:24 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:36:24 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:36:24 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:36:24 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:36:24 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNft5KIxwEgdwTqD-CgWzQHRf_FoqYilC4_z8sLEvoXo1R3M7HNE1MMy-1-GlWM0X8BruNgg2BCXLv_-0_S4kRyGh3lOQ6Sb9IfuhvN2rkuUyf5ySkxhKP32iNzWpbdPq8mfldEe_U0xhj5wtI02KiYIEO-zb6pTaOupaX4Sx0JOImss Apr 12 00:36:24 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:36:24 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:36:24 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:36:24 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:36:24 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:36:24 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:36:24 user devstack@n-api.service[72494]: X-Project-Id: fcf1fea74ef143e6b394e41e7c4ed495 Apr 12 00:36:24 user devstack@n-api.service[72494]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1300870234 Apr 12 00:36:24 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:36:24 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:36:24 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fcf1fea74ef143e6b394e41e7c4ed495"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fcf1fea74ef143e6b394e41e7c4ed495"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fcf1fea74ef143e6b394e41e7c4ed495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:36:24 user devstack@n-api.service[72494]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1300870234 Apr 12 00:36:24 user devstack@n-api.service[72494]: X-Tenant-Id: fcf1fea74ef143e6b394e41e7c4ed495 Apr 12 00:36:24 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1300870234 Apr 12 00:36:24 user devstack@n-api.service[72494]: X-User: tempest-ServerRescueNegativeTestJSON-1300870234-project-member Apr 12 00:36:24 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:36:24 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:36:24 user devstack@n-api.service[72494]: X-User-Id: 6b9421443b2f421298a934122c6a8b8c Apr 12 00:36:24 user devstack@n-api.service[72494]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1300870234-project-member Apr 12 00:36:24 user devstack@n-api.service[72494]: Apr 12 00:36:24 user devstack@n-api.service[72494]: {"volumeAttachment": {"volumeId": "2ad2b2d8-9483-4089-895d-b180c590ebd6"}} Apr 12 00:36:24 user devstack@n-api.service[72494]: method: > Apr 12 00:36:24 user devstack@n-api.service[72494]: exception: Cannot 'attach_volume' instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 while it is in vm_state rescued Apr 12 00:36:24 user devstack@n-api.service[72494]: action_args: {'server_id': '8d895d64-319f-4c67-8c20-ef0d0437a1f0', 'body': {'volumeAttachment': {'volumeId': '2ad2b2d8-9483-4089-895d-b180c590ebd6'}}} Apr 12 00:36:24 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 while it is in vm_state rescued Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 while it is in vm_state rescued Apr 12 00:36:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:36:24 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-c872804d-efa9-4139-a464-92c726aae3e9 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Returning 409 to user: Cannot 'attach_volume' instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 while it is in vm_state rescued {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:36:24 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-c872804d-efa9-4139-a464-92c726aae3e9 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.054756 Apr 12 00:36:24 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 134/403] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 00:36:24 2023] POST /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0/os-volume_attachments => generated 152 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 12 00:36:24 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-1a6b5e6e-71bb-41e7-9946-b34fccbe5fb8 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:24 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-1a6b5e6e-71bb-41e7-9946-b34fccbe5fb8 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1a6b5e6e-71bb-41e7-9946-b34fccbe5fb8 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1a6b5e6e-71bb-41e7-9946-b34fccbe5fb8 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1a6b5e6e-71bb-41e7-9946-b34fccbe5fb8 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1a6b5e6e-71bb-41e7-9946-b34fccbe5fb8 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1a6b5e6e-71bb-41e7-9946-b34fccbe5fb8 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1a6b5e6e-71bb-41e7-9946-b34fccbe5fb8 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:24 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-1a6b5e6e-71bb-41e7-9946-b34fccbe5fb8 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0/action" status: 202 len: 0 microversion: 2.1 time: 0.106503 Apr 12 00:36:24 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 133/404] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 00:36:24 2023] POST /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:36:24 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-251cda5b-f1d4-420f-bda4-857102a8258c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:24 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-251cda5b-f1d4-420f-bda4-857102a8258c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:24 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-251cda5b-f1d4-420f-bda4-857102a8258c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:24 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-251cda5b-f1d4-420f-bda4-857102a8258c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:24 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-251cda5b-f1d4-420f-bda4-857102a8258c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:24 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-251cda5b-f1d4-420f-bda4-857102a8258c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:24 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-251cda5b-f1d4-420f-bda4-857102a8258c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:24 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-251cda5b-f1d4-420f-bda4-857102a8258c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:24 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-251cda5b-f1d4-420f-bda4-857102a8258c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9421443b2f421298a934122c6a8b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf1fea74ef143e6b394e41e7c4ed495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:36:24 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-251cda5b-f1d4-420f-bda4-857102a8258c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0" status: 200 len: 1497 microversion: 2.1 time: 0.213599 Apr 12 00:36:24 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 138/405] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:36:24 2023] GET /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0 => generated 1497 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:24 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a37b7b1-c215-42f1-96c3-1bd1248aacc1"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:24 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:25 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-5648b1fc-7a89-4783-b7d8-7e6fb4f964b5 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.340807 Apr 12 00:36:25 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 135/406] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 00:36:24 2023] POST /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments => generated 194 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:25 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-aba0f05b-c91e-432d-914c-2ded84ccedfe req-e5d4db15-2186-4965-8d92-0f29285942d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d895d64-319f-4c67-8c20-ef0d0437a1f0", "name": "network-vif-unplugged", "status": "completed", "tag": "e92d06cb-6535-4389-b328-57add5f4f812"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:25 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:36:25 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=10 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:36:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-aba0f05b-c91e-432d-914c-2ded84ccedfe req-e5d4db15-2186-4965-8d92-0f29285942d0 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-aba0f05b-c91e-432d-914c-2ded84ccedfe req-e5d4db15-2186-4965-8d92-0f29285942d0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-aba0f05b-c91e-432d-914c-2ded84ccedfe req-e5d4db15-2186-4965-8d92-0f29285942d0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:25 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-aba0f05b-c91e-432d-914c-2ded84ccedfe req-e5d4db15-2186-4965-8d92-0f29285942d0 service nova] Creating event network-vif-unplugged:e92d06cb-6535-4389-b328-57add5f4f812 for instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 on user Apr 12 00:36:25 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-aba0f05b-c91e-432d-914c-2ded84ccedfe req-e5d4db15-2186-4965-8d92-0f29285942d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046348 Apr 12 00:36:25 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 134/407] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:36:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-8777b8d7-750e-404b-90eb-2db492446dd1 req-05f6bb9c-7d48-4b5a-be72-6603f7f9cb63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d895d64-319f-4c67-8c20-ef0d0437a1f0", "name": "network-vif-plugged", "status": "completed", "tag": "e92d06cb-6535-4389-b328-57add5f4f812"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:27 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:36:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-8777b8d7-750e-404b-90eb-2db492446dd1 req-05f6bb9c-7d48-4b5a-be72-6603f7f9cb63 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-8777b8d7-750e-404b-90eb-2db492446dd1 req-05f6bb9c-7d48-4b5a-be72-6603f7f9cb63 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-8777b8d7-750e-404b-90eb-2db492446dd1 req-05f6bb9c-7d48-4b5a-be72-6603f7f9cb63 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:27 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-8777b8d7-750e-404b-90eb-2db492446dd1 req-05f6bb9c-7d48-4b5a-be72-6603f7f9cb63 service nova] Creating event network-vif-plugged:e92d06cb-6535-4389-b328-57add5f4f812 for instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 on user Apr 12 00:36:27 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-8777b8d7-750e-404b-90eb-2db492446dd1 req-05f6bb9c-7d48-4b5a-be72-6603f7f9cb63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038945 Apr 12 00:36:27 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 139/408] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:36:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:29 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-3dcf7e49-ae6e-4b8b-a369-c2eb2e23370b req-8321ef8a-a4f5-4c00-a531-f9e71a096f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d895d64-319f-4c67-8c20-ef0d0437a1f0", "name": "network-vif-plugged", "status": "completed", "tag": "e92d06cb-6535-4389-b328-57add5f4f812"}, {"server_uuid": "8d895d64-319f-4c67-8c20-ef0d0437a1f0", "name": "network-vif-plugged", "status": "completed", "tag": "e92d06cb-6535-4389-b328-57add5f4f812"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-3dcf7e49-ae6e-4b8b-a369-c2eb2e23370b req-8321ef8a-a4f5-4c00-a531-f9e71a096f8b service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-3dcf7e49-ae6e-4b8b-a369-c2eb2e23370b req-8321ef8a-a4f5-4c00-a531-f9e71a096f8b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-3dcf7e49-ae6e-4b8b-a369-c2eb2e23370b req-8321ef8a-a4f5-4c00-a531-f9e71a096f8b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:29 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-3dcf7e49-ae6e-4b8b-a369-c2eb2e23370b req-8321ef8a-a4f5-4c00-a531-f9e71a096f8b service nova] Creating event network-vif-plugged:e92d06cb-6535-4389-b328-57add5f4f812 for instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 on user Apr 12 00:36:29 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-3dcf7e49-ae6e-4b8b-a369-c2eb2e23370b req-8321ef8a-a4f5-4c00-a531-f9e71a096f8b service nova] Creating event network-vif-plugged:e92d06cb-6535-4389-b328-57add5f4f812 for instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 on user Apr 12 00:36:29 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-3dcf7e49-ae6e-4b8b-a369-c2eb2e23370b req-8321ef8a-a4f5-4c00-a531-f9e71a096f8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039634 Apr 12 00:36:29 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 136/409] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:36:29 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:36:33 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:33 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:33 user devstack@n-api.service[72495]: DEBUG nova.objects.instance [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lazy-loading 'services' on Instance uuid 9d67708d-1bcf-4d32-8d45-22376ec72e34 {{(pid=72495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:36:33 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-5ec95f5a-6b4d-4e4e-b84e-b6a4e72db021 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments/2a37b7b1-c215-42f1-96c3-1bd1248aacc1" status: 202 len: 0 microversion: 2.1 time: 0.247283 Apr 12 00:36:33 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 135/410] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 00:36:33 2023] DELETE /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments/2a37b7b1-c215-42f1-96c3-1bd1248aacc1 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:36:33 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-418b593c-5683-4d02-9bd9-3e1d7c35edee tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:33 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-418b593c-5683-4d02-9bd9-3e1d7c35edee tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-418b593c-5683-4d02-9bd9-3e1d7c35edee tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-418b593c-5683-4d02-9bd9-3e1d7c35edee tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-418b593c-5683-4d02-9bd9-3e1d7c35edee tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-418b593c-5683-4d02-9bd9-3e1d7c35edee tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-418b593c-5683-4d02-9bd9-3e1d7c35edee tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-418b593c-5683-4d02-9bd9-3e1d7c35edee tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:33 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-418b593c-5683-4d02-9bd9-3e1d7c35edee tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058948 Apr 12 00:36:33 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 140/411] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:36:33 2023] GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:34 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-9b8de46c-00dd-445e-b2ad-12c99741f4be tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:34 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-9b8de46c-00dd-445e-b2ad-12c99741f4be tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9b8de46c-00dd-445e-b2ad-12c99741f4be tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9b8de46c-00dd-445e-b2ad-12c99741f4be tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9b8de46c-00dd-445e-b2ad-12c99741f4be tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9b8de46c-00dd-445e-b2ad-12c99741f4be tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9b8de46c-00dd-445e-b2ad-12c99741f4be tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9b8de46c-00dd-445e-b2ad-12c99741f4be tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:34 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-9b8de46c-00dd-445e-b2ad-12c99741f4be tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:36:34 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-9b8de46c-00dd-445e-b2ad-12c99741f4be tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ba310127-67a9-4245-87f6-555e35f30a16" status: 200 len: 1549 microversion: 2.1 time: 0.161050 Apr 12 00:36:34 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 137/412] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:36:34 2023] GET /compute/v2.1/servers/ba310127-67a9-4245-87f6-555e35f30a16 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:36:38 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-241003630", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "2e59f1f4-986f-4135-b7f2-1d333d3017ad"}]}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:38 user devstack@n-api.service[72495]: DEBUG nova.network.neutron [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] validate_networks() for [('2e59f1f4-986f-4135-b7f2-1d333d3017ad', None, None, None, None, None)] {{(pid=72495) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:36:38 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Flavor limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:36:38 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Image limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:36:38 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Flavor pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:36:38 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Image pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:36:38 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:36:38 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:38 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:38 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:38 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:38 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:38 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:38 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Getting quotas for project f4a7eb4a2a09418eacdeaccefbf7de15. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:36:38 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Getting quotas for user 69d6e340820641729772cf35648ef785 and project f4a7eb4a2a09418eacdeaccefbf7de15. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:36:38 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Going to run 1 instances... {{(pid=72495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:36:38 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=72495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:36:38 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-b123def8-f1f5-4ab5-84bf-f4c93889fdd5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.491980 Apr 12 00:36:38 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 136/413] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 00:36:38 2023] POST /compute/v2.1/servers => generated 378 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 00:36:38 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-e2d7aa71-dd38-4d7a-9dbc-ac810cedd5a5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:38 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-e2d7aa71-dd38-4d7a-9dbc-ac810cedd5a5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:38 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-e2d7aa71-dd38-4d7a-9dbc-ac810cedd5a5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:36:38 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-e2d7aa71-dd38-4d7a-9dbc-ac810cedd5a5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:36:38 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-e2d7aa71-dd38-4d7a-9dbc-ac810cedd5a5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:36:38 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-e2d7aa71-dd38-4d7a-9dbc-ac810cedd5a5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1277a40a-6389-4d88-bbc6-bda27d465c35" status: 200 len: 1394 microversion: 2.87 time: 0.078753 Apr 12 00:36:38 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 141/414] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:36:38 2023] GET /compute/v2.1/servers/1277a40a-6389-4d88-bbc6-bda27d465c35 => generated 1394 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:36:41 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-6c7ea6c9-41e8-4917-9fe3-fd5194c73e0b req-f244a8a6-1515-4576-8ebe-74fcbe7acba6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1277a40a-6389-4d88-bbc6-bda27d465c35", "tag": "8e32719d-1d2e-439a-9dba-9ac82140fbac"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-6c7ea6c9-41e8-4917-9fe3-fd5194c73e0b req-f244a8a6-1515-4576-8ebe-74fcbe7acba6 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-6c7ea6c9-41e8-4917-9fe3-fd5194c73e0b req-f244a8a6-1515-4576-8ebe-74fcbe7acba6 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-6c7ea6c9-41e8-4917-9fe3-fd5194c73e0b req-f244a8a6-1515-4576-8ebe-74fcbe7acba6 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:41 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-6c7ea6c9-41e8-4917-9fe3-fd5194c73e0b req-f244a8a6-1515-4576-8ebe-74fcbe7acba6 service nova] Creating event network-changed:8e32719d-1d2e-439a-9dba-9ac82140fbac for instance 1277a40a-6389-4d88-bbc6-bda27d465c35 on user Apr 12 00:36:41 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-6c7ea6c9-41e8-4917-9fe3-fd5194c73e0b req-f244a8a6-1515-4576-8ebe-74fcbe7acba6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028937 Apr 12 00:36:41 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 138/415] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:36:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:44 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:44 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:44 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=7 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:36:44 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:44 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:44 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:44 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:44 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:44 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:44 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:36:44 user devstack@n-api.service[72495]: DEBUG nova.objects.instance [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lazy-loading 'services' on Instance uuid dbe6d6bc-65a6-469a-89a0-7e4c51620b14 {{(pid=72495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:36:44 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-003ad4d2-767c-4cc2-adf7-a58d2a473a79 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/os-volume_attachments/d0edc110-1f0c-4311-b54d-6de6a1d1d8f2" status: 202 len: 0 microversion: 2.1 time: 0.169295 Apr 12 00:36:44 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 137/416] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 00:36:44 2023] DELETE /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/os-volume_attachments/d0edc110-1f0c-4311-b54d-6de6a1d1d8f2 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:36:44 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-374aadea-19b5-4ea1-ac26-089f60052edc tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:44 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-374aadea-19b5-4ea1-ac26-089f60052edc tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:44 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=34 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:36:44 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=25 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:36:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-374aadea-19b5-4ea1-ac26-089f60052edc tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-374aadea-19b5-4ea1-ac26-089f60052edc tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-374aadea-19b5-4ea1-ac26-089f60052edc tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-374aadea-19b5-4ea1-ac26-089f60052edc tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-374aadea-19b5-4ea1-ac26-089f60052edc tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-374aadea-19b5-4ea1-ac26-089f60052edc tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:44 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-374aadea-19b5-4ea1-ac26-089f60052edc tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053869 Apr 12 00:36:44 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 142/417] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:36:44 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:51 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-9e856f3a-8932-4230-b651-36746179159d tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:36:51 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-9e856f3a-8932-4230-b651-36746179159d tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:51 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:36:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9e856f3a-8932-4230-b651-36746179159d tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9e856f3a-8932-4230-b651-36746179159d tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9e856f3a-8932-4230-b651-36746179159d tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9e856f3a-8932-4230-b651-36746179159d tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9e856f3a-8932-4230-b651-36746179159d tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9e856f3a-8932-4230-b651-36746179159d tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:51 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:36:51 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-9e856f3a-8932-4230-b651-36746179159d tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.091612 Apr 12 00:36:51 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 139/418] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 00:36:51 2023] GET /compute/v2.1/servers/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/os-interface => generated 282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:52 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:36:52 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:36:52 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-03452981-1b7f-43dd-bdd0-69c9726be5dc req-abf2ae55-3aa5-432d-af69-607c65e516e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3", "tag": "40e300fb-a2c9-4770-8eee-d1b48baedf34"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-03452981-1b7f-43dd-bdd0-69c9726be5dc req-abf2ae55-3aa5-432d-af69-607c65e516e5 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-03452981-1b7f-43dd-bdd0-69c9726be5dc req-abf2ae55-3aa5-432d-af69-607c65e516e5 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-03452981-1b7f-43dd-bdd0-69c9726be5dc req-abf2ae55-3aa5-432d-af69-607c65e516e5 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:52 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-03452981-1b7f-43dd-bdd0-69c9726be5dc req-abf2ae55-3aa5-432d-af69-607c65e516e5 service nova] Creating event network-changed:40e300fb-a2c9-4770-8eee-d1b48baedf34 for instance 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 on user Apr 12 00:36:52 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-03452981-1b7f-43dd-bdd0-69c9726be5dc req-abf2ae55-3aa5-432d-af69-607c65e516e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039137 Apr 12 00:36:52 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 138/419] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:36:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:53 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:36:53 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-e04e254d-a17f-4249-a9bb-48a6173d62e9 req-f49e924f-bfe8-4d66-9dbb-60587d299eca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1277a40a-6389-4d88-bbc6-bda27d465c35", "name": "network-vif-plugged", "status": "completed", "tag": "8e32719d-1d2e-439a-9dba-9ac82140fbac"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:53 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-e04e254d-a17f-4249-a9bb-48a6173d62e9 req-f49e924f-bfe8-4d66-9dbb-60587d299eca service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:53 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-e04e254d-a17f-4249-a9bb-48a6173d62e9 req-f49e924f-bfe8-4d66-9dbb-60587d299eca service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:53 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-e04e254d-a17f-4249-a9bb-48a6173d62e9 req-f49e924f-bfe8-4d66-9dbb-60587d299eca service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:53 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-e04e254d-a17f-4249-a9bb-48a6173d62e9 req-f49e924f-bfe8-4d66-9dbb-60587d299eca service nova] Creating event network-vif-plugged:8e32719d-1d2e-439a-9dba-9ac82140fbac for instance 1277a40a-6389-4d88-bbc6-bda27d465c35 on user Apr 12 00:36:53 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-e04e254d-a17f-4249-a9bb-48a6173d62e9 req-f49e924f-bfe8-4d66-9dbb-60587d299eca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036767 Apr 12 00:36:53 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 143/420] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:36:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:54 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c45fcda-6866-44db-b3a0-bd507315f343"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:54 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:36:54 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:54 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:54 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:54 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:54 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:54 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:54 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-4222fa8d-6f91-4e83-897c-5736ffd00b05 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] 10.0.0.210 "POST /compute/v2.1/servers/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320498 Apr 12 00:36:54 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 140/421] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 00:36:54 2023] POST /compute/v2.1/servers/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:36:55 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-a5d9e26b-233c-4fc1-bac2-b63d2c7e5a87 req-33e430ab-0de9-47fb-9d7d-d158b0f45263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1277a40a-6389-4d88-bbc6-bda27d465c35", "name": "network-vif-plugged", "status": "completed", "tag": "8e32719d-1d2e-439a-9dba-9ac82140fbac"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:36:55 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a5d9e26b-233c-4fc1-bac2-b63d2c7e5a87 req-33e430ab-0de9-47fb-9d7d-d158b0f45263 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:36:55 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a5d9e26b-233c-4fc1-bac2-b63d2c7e5a87 req-33e430ab-0de9-47fb-9d7d-d158b0f45263 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:36:55 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a5d9e26b-233c-4fc1-bac2-b63d2c7e5a87 req-33e430ab-0de9-47fb-9d7d-d158b0f45263 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:36:55 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-a5d9e26b-233c-4fc1-bac2-b63d2c7e5a87 req-33e430ab-0de9-47fb-9d7d-d158b0f45263 service nova] Creating event network-vif-plugged:8e32719d-1d2e-439a-9dba-9ac82140fbac for instance 1277a40a-6389-4d88-bbc6-bda27d465c35 on user Apr 12 00:36:55 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-a5d9e26b-233c-4fc1-bac2-b63d2c7e5a87 req-33e430ab-0de9-47fb-9d7d-d158b0f45263 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030306 Apr 12 00:36:55 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 139/422] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:36:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:37:01 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-9494e158-8b97-4e27-91f3-81b1c4114f76 tempest-VolumesAdminNegativeTest-1980510080 tempest-VolumesAdminNegativeTest-1980510080-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "018f507b-111b-46c6-9089-a25a0297d171"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:37:01 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-9494e158-8b97-4e27-91f3-81b1c4114f76 tempest-VolumesAdminNegativeTest-1980510080 tempest-VolumesAdminNegativeTest-1980510080-project-admin] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:01 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9494e158-8b97-4e27-91f3-81b1c4114f76 tempest-VolumesAdminNegativeTest-1980510080 tempest-VolumesAdminNegativeTest-1980510080-project-admin] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:01 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9494e158-8b97-4e27-91f3-81b1c4114f76 tempest-VolumesAdminNegativeTest-1980510080 tempest-VolumesAdminNegativeTest-1980510080-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:01 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9494e158-8b97-4e27-91f3-81b1c4114f76 tempest-VolumesAdminNegativeTest-1980510080 tempest-VolumesAdminNegativeTest-1980510080-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:01 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9494e158-8b97-4e27-91f3-81b1c4114f76 tempest-VolumesAdminNegativeTest-1980510080 tempest-VolumesAdminNegativeTest-1980510080-project-admin] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:01 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9494e158-8b97-4e27-91f3-81b1c4114f76 tempest-VolumesAdminNegativeTest-1980510080 tempest-VolumesAdminNegativeTest-1980510080-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:01 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9494e158-8b97-4e27-91f3-81b1c4114f76 tempest-VolumesAdminNegativeTest-1980510080 tempest-VolumesAdminNegativeTest-1980510080-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:01 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-9494e158-8b97-4e27-91f3-81b1c4114f76 tempest-VolumesAdminNegativeTest-1980510080 tempest-VolumesAdminNegativeTest-1980510080-project-admin] HTTP exception thrown: Volume 018f507b-111b-46c6-9089-a25a0297d171 could not be found. Apr 12 00:37:01 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-9494e158-8b97-4e27-91f3-81b1c4114f76 tempest-VolumesAdminNegativeTest-1980510080 tempest-VolumesAdminNegativeTest-1980510080-project-admin] Request method failure captured: Apr 12 00:37:01 user devstack@n-api.service[72496]: request: PUT /compute/v2.1/servers/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/os-volume_attachments/0c45fcda-6866-44db-b3a0-bd507315f343 HTTP/1.1 Apr 12 00:37:01 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:37:01 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:37:01 user devstack@n-api.service[72496]: Connection: close Apr 12 00:37:01 user devstack@n-api.service[72496]: Content-Length: 74 Apr 12 00:37:01 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:37:01 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:37:01 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:37:01 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:37:01 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNfyycq7h_JK4kd7h82xEwGyq9lCMvqyyu_BcUmgTMq1rM17MTHI7xeQ-mkqVQZMzSYCjfEzpIeDIa86zF1wvjo6Xxl3bg4QTsRoXvEz9cmqT6lwx0lVPy_F0_sr26lR3yTdumMl7Wphzy8q4AoGZ3FdSAM0f4b7Ch_NKzgzC9l0azA0 Apr 12 00:37:01 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:37:01 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:37:01 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:37:01 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:37:01 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:37:01 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:37:01 user devstack@n-api.service[72496]: X-Project-Id: 92780baf42884d509917d805ab035c3e Apr 12 00:37:01 user devstack@n-api.service[72496]: X-Project-Name: tempest-VolumesAdminNegativeTest-1980510080 Apr 12 00:37:01 user devstack@n-api.service[72496]: X-Role: member,admin,reader Apr 12 00:37:01 user devstack@n-api.service[72496]: X-Roles: member,admin,reader Apr 12 00:37:01 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/92780baf42884d509917d805ab035c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/92780baf42884d509917d805ab035c3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/92780baf42884d509917d805ab035c3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:37:01 user devstack@n-api.service[72496]: X-Tenant: tempest-VolumesAdminNegativeTest-1980510080 Apr 12 00:37:01 user devstack@n-api.service[72496]: X-Tenant-Id: 92780baf42884d509917d805ab035c3e Apr 12 00:37:01 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1980510080 Apr 12 00:37:01 user devstack@n-api.service[72496]: X-User: tempest-VolumesAdminNegativeTest-1980510080-project-admin Apr 12 00:37:01 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:37:01 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:37:01 user devstack@n-api.service[72496]: X-User-Id: 43b614c2848e4f6b8a21f8f495adaa77 Apr 12 00:37:01 user devstack@n-api.service[72496]: X-User-Name: tempest-VolumesAdminNegativeTest-1980510080-project-admin Apr 12 00:37:01 user devstack@n-api.service[72496]: Apr 12 00:37:01 user devstack@n-api.service[72496]: {"volumeAttachment": {"volumeId": "018f507b-111b-46c6-9089-a25a0297d171"}} Apr 12 00:37:01 user devstack@n-api.service[72496]: method: > Apr 12 00:37:01 user devstack@n-api.service[72496]: exception: Volume 018f507b-111b-46c6-9089-a25a0297d171 could not be found. Apr 12 00:37:01 user devstack@n-api.service[72496]: action_args: {'server_id': '88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3', 'id': '0c45fcda-6866-44db-b3a0-bd507315f343', 'body': {'volumeAttachment': {'volumeId': '018f507b-111b-46c6-9089-a25a0297d171'}}} Apr 12 00:37:01 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 018f507b-111b-46c6-9089-a25a0297d171 could not be found. (HTTP 404) (Request-ID: req-18fdf34a-9649-4890-8893-72ca5c71de04) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 018f507b-111b-46c6-9089-a25a0297d171 could not be found. Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 018f507b-111b-46c6-9089-a25a0297d171 could not be found. Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 018f507b-111b-46c6-9089-a25a0297d171 could not be found. Apr 12 00:37:01 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:37:01 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-9494e158-8b97-4e27-91f3-81b1c4114f76 tempest-VolumesAdminNegativeTest-1980510080 tempest-VolumesAdminNegativeTest-1980510080-project-admin] Returning 400 to user: Volume 018f507b-111b-46c6-9089-a25a0297d171 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:37:01 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-9494e158-8b97-4e27-91f3-81b1c4114f76 tempest-VolumesAdminNegativeTest-1980510080 tempest-VolumesAdminNegativeTest-1980510080-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/os-volume_attachments/0c45fcda-6866-44db-b3a0-bd507315f343" status: 400 len: 107 microversion: 2.1 time: 0.250835 Apr 12 00:37:01 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 144/423] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 00:37:01 2023] PUT /compute/v2.1/servers/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/os-volume_attachments/0c45fcda-6866-44db-b3a0-bd507315f343 => generated 107 bytes in 252 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:37:01 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:01 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:01 user devstack@n-api.service[72494]: DEBUG nova.objects.instance [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lazy-loading 'services' on Instance uuid 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 {{(pid=72494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:37:01 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-5e08af39-065d-4a08-93f0-fb1020168bf2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/os-volume_attachments/0c45fcda-6866-44db-b3a0-bd507315f343" status: 202 len: 0 microversion: 2.1 time: 0.158752 Apr 12 00:37:01 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 141/424] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 00:37:01 2023] DELETE /compute/v2.1/servers/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/os-volume_attachments/0c45fcda-6866-44db-b3a0-bd507315f343 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:37:01 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-d9d75af4-6a09-44d5-b74c-bf0080493e62 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:01 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-d9d75af4-6a09-44d5-b74c-bf0080493e62 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:01 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d9d75af4-6a09-44d5-b74c-bf0080493e62 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:01 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d9d75af4-6a09-44d5-b74c-bf0080493e62 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:01 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d9d75af4-6a09-44d5-b74c-bf0080493e62 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:01 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d9d75af4-6a09-44d5-b74c-bf0080493e62 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:01 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d9d75af4-6a09-44d5-b74c-bf0080493e62 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:01 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d9d75af4-6a09-44d5-b74c-bf0080493e62 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:01 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-d9d75af4-6a09-44d5-b74c-bf0080493e62 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049715 Apr 12 00:37:01 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 140/425] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:37:01 2023] GET /compute/v2.1/servers/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:37:03 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:03 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:03 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-39152e34-ceb0-49f5-b834-be0d0413138f req-0aeecd90-7b35-41dc-8d11-951e6631b3a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19cc71e1-9b01-4bfd-9898-14b04bfe5fff", "tag": "b796ef8b-d964-459f-b12c-9be0133dd643"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:37:03 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:03 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:03 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:03 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:03 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:03 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:03 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-39152e34-ceb0-49f5-b834-be0d0413138f req-0aeecd90-7b35-41dc-8d11-951e6631b3a1 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:03 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-39152e34-ceb0-49f5-b834-be0d0413138f req-0aeecd90-7b35-41dc-8d11-951e6631b3a1 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:03 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-39152e34-ceb0-49f5-b834-be0d0413138f req-0aeecd90-7b35-41dc-8d11-951e6631b3a1 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:03 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-39152e34-ceb0-49f5-b834-be0d0413138f req-0aeecd90-7b35-41dc-8d11-951e6631b3a1 service nova] Creating event network-changed:b796ef8b-d964-459f-b12c-9be0133dd643 for instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff on user Apr 12 00:37:03 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-39152e34-ceb0-49f5-b834-be0d0413138f req-0aeecd90-7b35-41dc-8d11-951e6631b3a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031442 Apr 12 00:37:03 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 142/426] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:37:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:37:03 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Going to try to terminate instance {{(pid=72496) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:37:03 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-fd0d3330-b017-466c-bc79-15259d26152a tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff" status: 204 len: 0 microversion: 2.1 time: 0.134596 Apr 12 00:37:03 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 145/427] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:37:03 2023] DELETE /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:37:03 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-54d1c7c6-4a3a-41ea-bc86-77d19d7335e4 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:03 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-54d1c7c6-4a3a-41ea-bc86-77d19d7335e4 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:03 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-54d1c7c6-4a3a-41ea-bc86-77d19d7335e4 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:03 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-54d1c7c6-4a3a-41ea-bc86-77d19d7335e4 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:03 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-54d1c7c6-4a3a-41ea-bc86-77d19d7335e4 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:03 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-54d1c7c6-4a3a-41ea-bc86-77d19d7335e4 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:03 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-54d1c7c6-4a3a-41ea-bc86-77d19d7335e4 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:03 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-54d1c7c6-4a3a-41ea-bc86-77d19d7335e4 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:03 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-54d1c7c6-4a3a-41ea-bc86-77d19d7335e4 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391e2cd0c34b4e838c4cf86ba933270c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bc7149e49343889c32fc198b6a0500', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:37:03 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-54d1c7c6-4a3a-41ea-bc86-77d19d7335e4 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff" status: 200 len: 1556 microversion: 2.1 time: 0.238655 Apr 12 00:37:03 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 141/428] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:37:03 2023] GET /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff => generated 1556 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:03 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-e7050435-8438-4896-bfaf-0de7f8e148b7 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:03 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-e7050435-8438-4896-bfaf-0de7f8e148b7 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] [instance: 1b203e2e-a2ba-4989-94bc-2a78491a9b89] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:03 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e7050435-8438-4896-bfaf-0de7f8e148b7 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:03 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e7050435-8438-4896-bfaf-0de7f8e148b7 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:03 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e7050435-8438-4896-bfaf-0de7f8e148b7 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:03 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e7050435-8438-4896-bfaf-0de7f8e148b7 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:03 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e7050435-8438-4896-bfaf-0de7f8e148b7 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:03 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e7050435-8438-4896-bfaf-0de7f8e148b7 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:03 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-e7050435-8438-4896-bfaf-0de7f8e148b7 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] HTTP exception thrown: Instance 1b203e2e-a2ba-4989-94bc-2a78491a9b89 could not be found. Apr 12 00:37:03 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-e7050435-8438-4896-bfaf-0de7f8e148b7 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Request method failure captured: Apr 12 00:37:03 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/1b203e2e-a2ba-4989-94bc-2a78491a9b89 HTTP/1.1 Apr 12 00:37:03 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:37:03 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:37:03 user devstack@n-api.service[72494]: Connection: close Apr 12 00:37:03 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:37:03 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:37:03 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:37:03 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:37:03 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:37:03 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNfyGKf1_lAfhpt5KzKJo6wO4ZekZMZGrtFKeJiQrfF_Xldz4OQiixyeAK4LgJPDTKhQNoduFltlG4F_vMKi6TY24jqbVShfuH0dpTLdaGsu9_e634KIQ8u8TrpSI4rEd7Q9njgnwPz9kCIhgT5ecYlebI_mZv9XDnXLoMGKmDxsdisU Apr 12 00:37:03 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:37:03 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:37:03 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:37:03 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:37:03 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:37:03 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:37:03 user devstack@n-api.service[72494]: X-Project-Id: 48be6d35ad6c43c8b048811baffb8da8 Apr 12 00:37:03 user devstack@n-api.service[72494]: X-Project-Name: tempest-VolumesActionsTest-69590984 Apr 12 00:37:03 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:37:03 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:37:03 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/48be6d35ad6c43c8b048811baffb8da8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/48be6d35ad6c43c8b048811baffb8da8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/48be6d35ad6c43c8b048811baffb8da8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:37:03 user devstack@n-api.service[72494]: X-Tenant: tempest-VolumesActionsTest-69590984 Apr 12 00:37:03 user devstack@n-api.service[72494]: X-Tenant-Id: 48be6d35ad6c43c8b048811baffb8da8 Apr 12 00:37:03 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-VolumesActionsTest-69590984 Apr 12 00:37:03 user devstack@n-api.service[72494]: X-User: tempest-VolumesActionsTest-69590984-project-member Apr 12 00:37:03 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:37:03 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:37:03 user devstack@n-api.service[72494]: X-User-Id: f6d875a6e14446469a8a58b97a0e89d4 Apr 12 00:37:03 user devstack@n-api.service[72494]: X-User-Name: tempest-VolumesActionsTest-69590984-project-member Apr 12 00:37:03 user devstack@n-api.service[72494]: method: > Apr 12 00:37:03 user devstack@n-api.service[72494]: exception: Instance 1b203e2e-a2ba-4989-94bc-2a78491a9b89 could not be found. Apr 12 00:37:03 user devstack@n-api.service[72494]: action_args: {'id': '1b203e2e-a2ba-4989-94bc-2a78491a9b89'} Apr 12 00:37:03 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b203e2e-a2ba-4989-94bc-2a78491a9b89 could not be found. Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b203e2e-a2ba-4989-94bc-2a78491a9b89 could not be found. Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b203e2e-a2ba-4989-94bc-2a78491a9b89 could not be found. Apr 12 00:37:03 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:37:03 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-e7050435-8438-4896-bfaf-0de7f8e148b7 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] Returning 404 to user: Instance 1b203e2e-a2ba-4989-94bc-2a78491a9b89 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:37:03 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-e7050435-8438-4896-bfaf-0de7f8e148b7 tempest-VolumesActionsTest-69590984 tempest-VolumesActionsTest-69590984-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b203e2e-a2ba-4989-94bc-2a78491a9b89" status: 404 len: 111 microversion: 2.1 time: 0.045911 Apr 12 00:37:03 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 143/429] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:37:03 2023] GET /compute/v2.1/servers/1b203e2e-a2ba-4989-94bc-2a78491a9b89 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:37:04 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-b191f3c3-4cb8-49df-a31b-7cbbd5ee1624 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:04 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-b191f3c3-4cb8-49df-a31b-7cbbd5ee1624 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b191f3c3-4cb8-49df-a31b-7cbbd5ee1624 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b191f3c3-4cb8-49df-a31b-7cbbd5ee1624 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b191f3c3-4cb8-49df-a31b-7cbbd5ee1624 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b191f3c3-4cb8-49df-a31b-7cbbd5ee1624 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b191f3c3-4cb8-49df-a31b-7cbbd5ee1624 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b191f3c3-4cb8-49df-a31b-7cbbd5ee1624 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:04 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-b191f3c3-4cb8-49df-a31b-7cbbd5ee1624 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045838 Apr 12 00:37:04 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 146/430] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:37:04 2023] GET /compute/v2.1/servers/6c1ae397-d28d-4143-9aa1-cf00e799f9b5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:37:05 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-d6b0926d-e989-4f32-b43b-05a8f3acccd1 req-ae99bf3b-dbae-4221-90df-71ebf9bbcc32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19cc71e1-9b01-4bfd-9898-14b04bfe5fff", "name": "network-vif-deleted", "tag": "b796ef8b-d964-459f-b12c-9be0133dd643"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:37:05 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d6b0926d-e989-4f32-b43b-05a8f3acccd1 req-ae99bf3b-dbae-4221-90df-71ebf9bbcc32 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:05 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d6b0926d-e989-4f32-b43b-05a8f3acccd1 req-ae99bf3b-dbae-4221-90df-71ebf9bbcc32 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:05 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d6b0926d-e989-4f32-b43b-05a8f3acccd1 req-ae99bf3b-dbae-4221-90df-71ebf9bbcc32 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:05 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-d6b0926d-e989-4f32-b43b-05a8f3acccd1 req-ae99bf3b-dbae-4221-90df-71ebf9bbcc32 service nova] Creating event network-vif-deleted:b796ef8b-d964-459f-b12c-9be0133dd643 for instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff on user Apr 12 00:37:05 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:05 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:05 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-d6b0926d-e989-4f32-b43b-05a8f3acccd1 req-ae99bf3b-dbae-4221-90df-71ebf9bbcc32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032226 Apr 12 00:37:05 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 142/431] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:37:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:37:05 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-d2e15a85-6673-432d-b5fa-a76421979900 req-133b24ae-d372-4c79-90be-9e52318e1be6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c1ae397-d28d-4143-9aa1-cf00e799f9b5", "tag": "f0e98861-35b6-489e-9f17-463054e69601"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:37:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d2e15a85-6673-432d-b5fa-a76421979900 req-133b24ae-d372-4c79-90be-9e52318e1be6 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d2e15a85-6673-432d-b5fa-a76421979900 req-133b24ae-d372-4c79-90be-9e52318e1be6 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d2e15a85-6673-432d-b5fa-a76421979900 req-133b24ae-d372-4c79-90be-9e52318e1be6 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:05 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-d2e15a85-6673-432d-b5fa-a76421979900 req-133b24ae-d372-4c79-90be-9e52318e1be6 service nova] Creating event network-changed:f0e98861-35b6-489e-9f17-463054e69601 for instance 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 on user Apr 12 00:37:05 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-d2e15a85-6673-432d-b5fa-a76421979900 req-133b24ae-d372-4c79-90be-9e52318e1be6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031231 Apr 12 00:37:05 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 147/432] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:37:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:37:05 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Going to try to terminate instance {{(pid=72494) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:37:05 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-df76ed5a-29e7-405e-b853-ae6053bf20a5 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6c1ae397-d28d-4143-9aa1-cf00e799f9b5" status: 204 len: 0 microversion: 2.1 time: 0.155350 Apr 12 00:37:05 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 144/433] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:37:05 2023] DELETE /compute/v2.1/servers/6c1ae397-d28d-4143-9aa1-cf00e799f9b5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:37:05 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-3cdce828-8fb2-491a-9a9b-887fca4f7309 req-9022df09-a680-4afb-b62b-c8a34eb1ff19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19cc71e1-9b01-4bfd-9898-14b04bfe5fff", "name": "network-vif-unplugged", "status": "completed", "tag": "b796ef8b-d964-459f-b12c-9be0133dd643"}, {"server_uuid": "19cc71e1-9b01-4bfd-9898-14b04bfe5fff", "name": "network-vif-plugged", "status": "completed", "tag": "b796ef8b-d964-459f-b12c-9be0133dd643"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:37:05 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-fbf465a5-8236-4a5a-bb04-dfe9120bb9a0 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:05 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-fbf465a5-8236-4a5a-bb04-dfe9120bb9a0 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:05 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3cdce828-8fb2-491a-9a9b-887fca4f7309 req-9022df09-a680-4afb-b62b-c8a34eb1ff19 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:05 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3cdce828-8fb2-491a-9a9b-887fca4f7309 req-9022df09-a680-4afb-b62b-c8a34eb1ff19 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:05 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3cdce828-8fb2-491a-9a9b-887fca4f7309 req-9022df09-a680-4afb-b62b-c8a34eb1ff19 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fbf465a5-8236-4a5a-bb04-dfe9120bb9a0 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fbf465a5-8236-4a5a-bb04-dfe9120bb9a0 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fbf465a5-8236-4a5a-bb04-dfe9120bb9a0 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fbf465a5-8236-4a5a-bb04-dfe9120bb9a0 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fbf465a5-8236-4a5a-bb04-dfe9120bb9a0 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fbf465a5-8236-4a5a-bb04-dfe9120bb9a0 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:05 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-3cdce828-8fb2-491a-9a9b-887fca4f7309 req-9022df09-a680-4afb-b62b-c8a34eb1ff19 service nova] Creating event network-vif-unplugged:b796ef8b-d964-459f-b12c-9be0133dd643 for instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff on user Apr 12 00:37:05 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-3cdce828-8fb2-491a-9a9b-887fca4f7309 req-9022df09-a680-4afb-b62b-c8a34eb1ff19 service nova] Creating event network-vif-plugged:b796ef8b-d964-459f-b12c-9be0133dd643 for instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff on user Apr 12 00:37:05 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-3cdce828-8fb2-491a-9a9b-887fca4f7309 req-9022df09-a680-4afb-b62b-c8a34eb1ff19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.039865 Apr 12 00:37:05 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 143/434] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:37:05 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:37:05 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-76970231-f278-465a-88d1-b3601ddfe58e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:05 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-76970231-f278-465a-88d1-b3601ddfe58e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-76970231-f278-465a-88d1-b3601ddfe58e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-76970231-f278-465a-88d1-b3601ddfe58e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-76970231-f278-465a-88d1-b3601ddfe58e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-76970231-f278-465a-88d1-b3601ddfe58e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-76970231-f278-465a-88d1-b3601ddfe58e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-76970231-f278-465a-88d1-b3601ddfe58e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:05 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-fbf465a5-8236-4a5a-bb04-dfe9120bb9a0 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e843a45549943cb88b1b3123a2fbe8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0ea21a2d4d400cba79444c68b58aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:37:05 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-fbf465a5-8236-4a5a-bb04-dfe9120bb9a0 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c1ae397-d28d-4143-9aa1-cf00e799f9b5" status: 200 len: 1662 microversion: 2.1 time: 0.246574 Apr 12 00:37:05 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 148/435] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:37:05 2023] GET /compute/v2.1/servers/6c1ae397-d28d-4143-9aa1-cf00e799f9b5 => generated 1662 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:37:05 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-76970231-f278-465a-88d1-b3601ddfe58e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373f582479c441e8ce9849ca694a186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f3c567dc84773a33d596920df727a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:37:05 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-76970231-f278-465a-88d1-b3601ddfe58e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8fd7bb9c-9e20-49f2-8848-162a784b9885" status: 200 len: 1545 microversion: 2.1 time: 0.180516 Apr 12 00:37:05 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 145/436] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:37:05 2023] GET /compute/v2.1/servers/8fd7bb9c-9e20-49f2-8848-162a784b9885 => generated 1545 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:07 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-0b4b09d0-1610-4881-98e1-30f736f60514 req-da720756-3e1b-43aa-8e38-60c3b60685c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c1ae397-d28d-4143-9aa1-cf00e799f9b5", "name": "network-vif-deleted", "tag": "f0e98861-35b6-489e-9f17-463054e69601"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:37:07 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-0b4b09d0-1610-4881-98e1-30f736f60514 req-da720756-3e1b-43aa-8e38-60c3b60685c6 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:07 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-0b4b09d0-1610-4881-98e1-30f736f60514 req-da720756-3e1b-43aa-8e38-60c3b60685c6 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:07 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-0b4b09d0-1610-4881-98e1-30f736f60514 req-da720756-3e1b-43aa-8e38-60c3b60685c6 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:07 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-0b4b09d0-1610-4881-98e1-30f736f60514 req-da720756-3e1b-43aa-8e38-60c3b60685c6 service nova] Creating event network-vif-deleted:f0e98861-35b6-489e-9f17-463054e69601 for instance 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 on user Apr 12 00:37:07 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-f6b79365-0501-4777-916e-4b8c60c9f0c2 req-8a87ea5c-3123-4281-abf3-5542cbdafec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c1ae397-d28d-4143-9aa1-cf00e799f9b5", "name": "network-vif-unplugged", "status": "completed", "tag": "f0e98861-35b6-489e-9f17-463054e69601"}, {"server_uuid": "6c1ae397-d28d-4143-9aa1-cf00e799f9b5", "name": "network-vif-plugged", "status": "completed", "tag": "f0e98861-35b6-489e-9f17-463054e69601"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:37:07 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-0b4b09d0-1610-4881-98e1-30f736f60514 req-da720756-3e1b-43aa-8e38-60c3b60685c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038266 Apr 12 00:37:07 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 144/437] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:37:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:37:07 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-f6b79365-0501-4777-916e-4b8c60c9f0c2 req-8a87ea5c-3123-4281-abf3-5542cbdafec4 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:07 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-f6b79365-0501-4777-916e-4b8c60c9f0c2 req-8a87ea5c-3123-4281-abf3-5542cbdafec4 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:07 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-f6b79365-0501-4777-916e-4b8c60c9f0c2 req-8a87ea5c-3123-4281-abf3-5542cbdafec4 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:07 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-f6b79365-0501-4777-916e-4b8c60c9f0c2 req-8a87ea5c-3123-4281-abf3-5542cbdafec4 service nova] Creating event network-vif-unplugged:f0e98861-35b6-489e-9f17-463054e69601 for instance 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 on user Apr 12 00:37:07 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-f6b79365-0501-4777-916e-4b8c60c9f0c2 req-8a87ea5c-3123-4281-abf3-5542cbdafec4 service nova] Creating event network-vif-plugged:f0e98861-35b6-489e-9f17-463054e69601 for instance 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 on user Apr 12 00:37:07 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-f6b79365-0501-4777-916e-4b8c60c9f0c2 req-8a87ea5c-3123-4281-abf3-5542cbdafec4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.036902 Apr 12 00:37:07 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 149/438] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:37:07 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:37:14 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-0dae5a7f-07f0-4889-84b6-64c30e931e9f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:14 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-0dae5a7f-07f0-4889-84b6-64c30e931e9f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0dae5a7f-07f0-4889-84b6-64c30e931e9f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0dae5a7f-07f0-4889-84b6-64c30e931e9f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0dae5a7f-07f0-4889-84b6-64c30e931e9f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0dae5a7f-07f0-4889-84b6-64c30e931e9f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0dae5a7f-07f0-4889-84b6-64c30e931e9f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0dae5a7f-07f0-4889-84b6-64c30e931e9f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:14 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-0dae5a7f-07f0-4889-84b6-64c30e931e9f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9421443b2f421298a934122c6a8b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf1fea74ef143e6b394e41e7c4ed495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:37:14 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-0dae5a7f-07f0-4889-84b6-64c30e931e9f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0" status: 200 len: 1503 microversion: 2.1 time: 0.167803 Apr 12 00:37:14 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 146/439] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:37:14 2023] GET /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:20 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=15 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:37:20 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:37:20 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-2dc9647d-2fc3-4908-a81c-d84621212aa4 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-595262395", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "destination_type": "local"}, {"source_type": "volume", "uuid": "1e233644-07a3-4ae2-bc98-dde7f0d2a5f0", "destination_type": "invalid"}], "networks": [{"uuid": "4588d0e1-772f-4c76-b467-7e46031e477d"}]}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:37:20 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-2dc9647d-2fc3-4908-a81c-d84621212aa4 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Request method failure captured: Apr 12 00:37:20 user devstack@n-api.service[72495]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 12 00:37:20 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:37:20 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:37:20 user devstack@n-api.service[72495]: Connection: close Apr 12 00:37:20 user devstack@n-api.service[72495]: Content-Length: 493 Apr 12 00:37:20 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:37:20 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:37:20 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:37:20 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:37:20 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNft1qKkmjD8Nll-qUgF19N1LJeB8PdcRbdn5Uq6buO7cPBS5Ov8OoI4tZ5vt-jvCknrLUCUXFnwniWtwxerLQ3Ye5xXh85fQ6mUUIOhguVUuxf5ZIys8tRE0XamxX86aNJtrX6fu_BHxUNtwTPq_PEt8q2KNpjT1y3XmuQXDJ2yaqus Apr 12 00:37:20 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:37:20 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:37:20 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:37:20 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:37:20 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:37:20 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:37:20 user devstack@n-api.service[72495]: X-Project-Id: 6ee31cdc6f4e4c2b9a8ec1e1c5076010 Apr 12 00:37:20 user devstack@n-api.service[72495]: X-Project-Name: tempest-ServersNegativeTestJSON-103053763 Apr 12 00:37:20 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:37:20 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:37:20 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ee31cdc6f4e4c2b9a8ec1e1c5076010"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6ee31cdc6f4e4c2b9a8ec1e1c5076010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ee31cdc6f4e4c2b9a8ec1e1c5076010"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:37:20 user devstack@n-api.service[72495]: X-Tenant: tempest-ServersNegativeTestJSON-103053763 Apr 12 00:37:20 user devstack@n-api.service[72495]: X-Tenant-Id: 6ee31cdc6f4e4c2b9a8ec1e1c5076010 Apr 12 00:37:20 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-ServersNegativeTestJSON-103053763 Apr 12 00:37:20 user devstack@n-api.service[72495]: X-User: tempest-ServersNegativeTestJSON-103053763-project-member Apr 12 00:37:20 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:37:20 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:37:20 user devstack@n-api.service[72495]: X-User-Id: 920d6d79e38e45fcb5153e712605764f Apr 12 00:37:20 user devstack@n-api.service[72495]: X-User-Name: tempest-ServersNegativeTestJSON-103053763-project-member Apr 12 00:37:20 user devstack@n-api.service[72495]: Apr 12 00:37:20 user devstack@n-api.service[72495]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-595262395", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "destination_type": "local"}, {"source_type": "volume", "uuid": "1e233644-07a3-4ae2-bc98-dde7f0d2a5f0", "destination_type": "invalid"}], "networks": [{"uuid": "4588d0e1-772f-4c76-b467-7e46031e477d"}]}} Apr 12 00:37:20 user devstack@n-api.service[72495]: method: > Apr 12 00:37:20 user devstack@n-api.service[72495]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 12 00:37:20 user devstack@n-api.service[72495]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-595262395', 'imageRef': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '7ae54858-7fe8-4bde-be8c-1b0f88b691ea', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '1e233644-07a3-4ae2-bc98-dde7f0d2a5f0', 'destination_type': 'invalid'}], 'networks': [{'uuid': '4588d0e1-772f-4c76-b467-7e46031e477d'}]}}} Apr 12 00:37:20 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise error Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi 'invalid' Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 12 00:37:20 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:37:20 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-2dc9647d-2fc3-4908-a81c-d84621212aa4 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:37:20 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-2dc9647d-2fc3-4908-a81c-d84621212aa4 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.018905 Apr 12 00:37:20 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 145/440] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:37:20 2023] POST /compute/v2.1/servers => generated 155 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:37:20 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:37:20 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:37:20 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-37f048f8-eb1b-4442-b592-515b7bb2200a tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:20 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-37f048f8-eb1b-4442-b592-515b7bb2200a tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-37f048f8-eb1b-4442-b592-515b7bb2200a tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-37f048f8-eb1b-4442-b592-515b7bb2200a tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-37f048f8-eb1b-4442-b592-515b7bb2200a tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-37f048f8-eb1b-4442-b592-515b7bb2200a tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-37f048f8-eb1b-4442-b592-515b7bb2200a tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-37f048f8-eb1b-4442-b592-515b7bb2200a tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:21 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-37f048f8-eb1b-4442-b592-515b7bb2200a tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920d6d79e38e45fcb5153e712605764f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee31cdc6f4e4c2b9a8ec1e1c5076010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:37:21 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-37f048f8-eb1b-4442-b592-515b7bb2200a tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" status: 200 len: 1493 microversion: 2.1 time: 0.158755 Apr 12 00:37:21 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 150/441] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:37:20 2023] GET /compute/v2.1/servers/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 => generated 1493 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:23 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-a0b4ff0a-ea11-427b-baa0-246b8c8b1650 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:23 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-a0b4ff0a-ea11-427b-baa0-246b8c8b1650 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:23 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:37:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a0b4ff0a-ea11-427b-baa0-246b8c8b1650 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a0b4ff0a-ea11-427b-baa0-246b8c8b1650 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a0b4ff0a-ea11-427b-baa0-246b8c8b1650 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a0b4ff0a-ea11-427b-baa0-246b8c8b1650 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a0b4ff0a-ea11-427b-baa0-246b8c8b1650 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a0b4ff0a-ea11-427b-baa0-246b8c8b1650 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:23 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:37:23 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-a0b4ff0a-ea11-427b-baa0-246b8c8b1650 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083246 Apr 12 00:37:23 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 147/442] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:37:23 2023] GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 12 00:37:28 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-f8126186-3921-4851-8656-6fb4949dbf0a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:28 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-f8126186-3921-4851-8656-6fb4949dbf0a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-f8126186-3921-4851-8656-6fb4949dbf0a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-f8126186-3921-4851-8656-6fb4949dbf0a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-f8126186-3921-4851-8656-6fb4949dbf0a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-f8126186-3921-4851-8656-6fb4949dbf0a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-f8126186-3921-4851-8656-6fb4949dbf0a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-f8126186-3921-4851-8656-6fb4949dbf0a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:29 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-f8126186-3921-4851-8656-6fb4949dbf0a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:37:29 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-f8126186-3921-4851-8656-6fb4949dbf0a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:37:29 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-f8126186-3921-4851-8656-6fb4949dbf0a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:37:29 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-f8126186-3921-4851-8656-6fb4949dbf0a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1277a40a-6389-4d88-bbc6-bda27d465c35" status: 200 len: 1768 microversion: 2.87 time: 0.169743 Apr 12 00:37:29 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 146/443] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:37:28 2023] GET /compute/v2.1/servers/1277a40a-6389-4d88-bbc6-bda27d465c35 => generated 1768 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:37:33 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-752173567", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:37:33 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:37:33 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:37:33 user devstack@n-api.service[72496]: DEBUG nova.network.neutron [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] validate_networks() for None {{(pid=72496) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:37:33 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Flavor limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:37:33 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Image limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:37:33 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Flavor pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:37:33 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Image pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:37:33 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:37:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:33 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Getting quotas for project 4d6cebaed9654692bd9aef950a08741b. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:37:33 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Getting quotas for user 7724cf4de81c4147929f43fd8744e8f9 and project 4d6cebaed9654692bd9aef950a08741b. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:37:33 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Going to run 1 instances... {{(pid=72496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:37:33 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:37:33 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-8ff84d87-a1a0-476b-bfd0-22f7234d2967 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.419166 Apr 12 00:37:33 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 151/444] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:37:33 2023] POST /compute/v2.1/servers => generated 378 bytes in 420 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:37:33 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-592e3715-60fe-466f-a461-900c71b8a16f tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:33 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-592e3715-60fe-466f-a461-900c71b8a16f tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:33 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:37:33 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=5 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:37:33 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-592e3715-60fe-466f-a461-900c71b8a16f tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724cf4de81c4147929f43fd8744e8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6cebaed9654692bd9aef950a08741b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:37:33 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-592e3715-60fe-466f-a461-900c71b8a16f tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] 10.0.0.210 "GET /compute/v2.1/servers/daa798af-8437-4083-b73c-92b0cb39d861" status: 200 len: 1208 microversion: 2.1 time: 0.073333 Apr 12 00:37:33 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 148/445] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:37:33 2023] GET /compute/v2.1/servers/daa798af-8437-4083-b73c-92b0cb39d861 => generated 1208 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:34 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-a22005f8-546e-4de7-ab21-af66df713742 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:34 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-a22005f8-546e-4de7-ab21-af66df713742 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-a22005f8-546e-4de7-ab21-af66df713742 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-a22005f8-546e-4de7-ab21-af66df713742 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-a22005f8-546e-4de7-ab21-af66df713742 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-a22005f8-546e-4de7-ab21-af66df713742 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-a22005f8-546e-4de7-ab21-af66df713742 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-a22005f8-546e-4de7-ab21-af66df713742 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:34 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-a22005f8-546e-4de7-ab21-af66df713742 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043690 Apr 12 00:37:34 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 147/446] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:37:34 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:37:34 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-628af848-6135-446f-a7dc-f281832ba72f tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:34 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-628af848-6135-446f-a7dc-f281832ba72f tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-628af848-6135-446f-a7dc-f281832ba72f tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-628af848-6135-446f-a7dc-f281832ba72f tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-628af848-6135-446f-a7dc-f281832ba72f tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-628af848-6135-446f-a7dc-f281832ba72f tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-628af848-6135-446f-a7dc-f281832ba72f tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-628af848-6135-446f-a7dc-f281832ba72f tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:35 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-b8ac2a59-dbe5-4878-986d-3af8cb4edea5 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:35 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-b8ac2a59-dbe5-4878-986d-3af8cb4edea5 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b8ac2a59-dbe5-4878-986d-3af8cb4edea5 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b8ac2a59-dbe5-4878-986d-3af8cb4edea5 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b8ac2a59-dbe5-4878-986d-3af8cb4edea5 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b8ac2a59-dbe5-4878-986d-3af8cb4edea5 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b8ac2a59-dbe5-4878-986d-3af8cb4edea5 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b8ac2a59-dbe5-4878-986d-3af8cb4edea5 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:35 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-628af848-6135-446f-a7dc-f281832ba72f tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:37:35 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-628af848-6135-446f-a7dc-f281832ba72f tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 200 len: 1676 microversion: 2.1 time: 0.174207 Apr 12 00:37:35 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 152/447] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:37:34 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:35 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-990cf1ac-04d9-4276-a075-38f24e45b273 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:35 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-990cf1ac-04d9-4276-a075-38f24e45b273 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-990cf1ac-04d9-4276-a075-38f24e45b273 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-990cf1ac-04d9-4276-a075-38f24e45b273 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-990cf1ac-04d9-4276-a075-38f24e45b273 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-990cf1ac-04d9-4276-a075-38f24e45b273 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-990cf1ac-04d9-4276-a075-38f24e45b273 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-990cf1ac-04d9-4276-a075-38f24e45b273 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:35 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-b8ac2a59-dbe5-4878-986d-3af8cb4edea5 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:37:35 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-b8ac2a59-dbe5-4878-986d-3af8cb4edea5 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ba310127-67a9-4245-87f6-555e35f30a16" status: 200 len: 1549 microversion: 2.1 time: 0.177891 Apr 12 00:37:35 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 149/448] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:37:35 2023] GET /compute/v2.1/servers/ba310127-67a9-4245-87f6-555e35f30a16 => generated 1549 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:35 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:35 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:35 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-990cf1ac-04d9-4276-a075-38f24e45b273 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:37:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:35 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-990cf1ac-04d9-4276-a075-38f24e45b273 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 200 len: 1676 microversion: 2.1 time: 0.169202 Apr 12 00:37:35 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 148/449] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:37:35 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:35 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-50da6ca5-5a2f-46ce-a03a-b177466a7119 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:35 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-50da6ca5-5a2f-46ce-a03a-b177466a7119 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-50da6ca5-5a2f-46ce-a03a-b177466a7119 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:35 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Going to try to terminate instance {{(pid=72496) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:37:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-50da6ca5-5a2f-46ce-a03a-b177466a7119 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-50da6ca5-5a2f-46ce-a03a-b177466a7119 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-50da6ca5-5a2f-46ce-a03a-b177466a7119 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-50da6ca5-5a2f-46ce-a03a-b177466a7119 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-50da6ca5-5a2f-46ce-a03a-b177466a7119 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:35 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-4f762478-0d01-4542-9946-9035397fbf43 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ba310127-67a9-4245-87f6-555e35f30a16" status: 204 len: 0 microversion: 2.1 time: 0.160991 Apr 12 00:37:35 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 153/450] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:37:35 2023] DELETE /compute/v2.1/servers/ba310127-67a9-4245-87f6-555e35f30a16 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:37:35 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-d7fd8b8e-9988-448f-a689-aab6cfec433c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:35 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-d7fd8b8e-9988-448f-a689-aab6cfec433c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d7fd8b8e-9988-448f-a689-aab6cfec433c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d7fd8b8e-9988-448f-a689-aab6cfec433c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d7fd8b8e-9988-448f-a689-aab6cfec433c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d7fd8b8e-9988-448f-a689-aab6cfec433c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d7fd8b8e-9988-448f-a689-aab6cfec433c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d7fd8b8e-9988-448f-a689-aab6cfec433c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:35 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-50da6ca5-5a2f-46ce-a03a-b177466a7119 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:37:35 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-50da6ca5-5a2f-46ce-a03a-b177466a7119 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 200 len: 1676 microversion: 2.1 time: 0.179004 Apr 12 00:37:35 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 150/451] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:37:35 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:35 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-d7add543-8de2-4a62-9145-727f860797d1 req-3fd19fee-25bb-4416-9f93-0424bf079468 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d67708d-1bcf-4d32-8d45-22376ec72e34", "tag": "71a3bef9-13f4-4aab-ba85-a26faa225efb"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:37:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d7add543-8de2-4a62-9145-727f860797d1 req-3fd19fee-25bb-4416-9f93-0424bf079468 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d7add543-8de2-4a62-9145-727f860797d1 req-3fd19fee-25bb-4416-9f93-0424bf079468 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d7add543-8de2-4a62-9145-727f860797d1 req-3fd19fee-25bb-4416-9f93-0424bf079468 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:35 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-d7add543-8de2-4a62-9145-727f860797d1 req-3fd19fee-25bb-4416-9f93-0424bf079468 service nova] Creating event network-changed:71a3bef9-13f4-4aab-ba85-a26faa225efb for instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 on user Apr 12 00:37:35 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-d7add543-8de2-4a62-9145-727f860797d1 req-3fd19fee-25bb-4416-9f93-0424bf079468 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033069 Apr 12 00:37:35 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 154/452] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:37:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:37:35 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-d7fd8b8e-9988-448f-a689-aab6cfec433c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:37:35 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-d7fd8b8e-9988-448f-a689-aab6cfec433c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ba310127-67a9-4245-87f6-555e35f30a16" status: 200 len: 1555 microversion: 2.1 time: 0.292881 Apr 12 00:37:35 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 149/453] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:37:35 2023] GET /compute/v2.1/servers/ba310127-67a9-4245-87f6-555e35f30a16 => generated 1555 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:37 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-1313e47f-5493-49a5-9292-53761281a4b8 req-c32d65cd-a37a-41f6-9e6a-4f57d25bbff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba310127-67a9-4245-87f6-555e35f30a16", "name": "network-vif-deleted", "tag": "903dfac0-8003-4008-b135-5da44763c9ff"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:37:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-1313e47f-5493-49a5-9292-53761281a4b8 req-c32d65cd-a37a-41f6-9e6a-4f57d25bbff0 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-1313e47f-5493-49a5-9292-53761281a4b8 req-c32d65cd-a37a-41f6-9e6a-4f57d25bbff0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-1313e47f-5493-49a5-9292-53761281a4b8 req-c32d65cd-a37a-41f6-9e6a-4f57d25bbff0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:37 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-1313e47f-5493-49a5-9292-53761281a4b8 req-c32d65cd-a37a-41f6-9e6a-4f57d25bbff0 service nova] Creating event network-vif-deleted:903dfac0-8003-4008-b135-5da44763c9ff for instance ba310127-67a9-4245-87f6-555e35f30a16 on user Apr 12 00:37:37 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-1313e47f-5493-49a5-9292-53761281a4b8 req-c32d65cd-a37a-41f6-9e6a-4f57d25bbff0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032945 Apr 12 00:37:37 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 151/454] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:37:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:37:37 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-f5dc6933-4844-4a0b-9bd3-f045f27b6247 req-b3d5b15c-ff62-4994-ae49-6dde841ab7d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba310127-67a9-4245-87f6-555e35f30a16", "name": "network-vif-unplugged", "status": "completed", "tag": "903dfac0-8003-4008-b135-5da44763c9ff"}, {"server_uuid": "ba310127-67a9-4245-87f6-555e35f30a16", "name": "network-vif-plugged", "status": "completed", "tag": "903dfac0-8003-4008-b135-5da44763c9ff"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:37:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-f5dc6933-4844-4a0b-9bd3-f045f27b6247 req-b3d5b15c-ff62-4994-ae49-6dde841ab7d8 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-f5dc6933-4844-4a0b-9bd3-f045f27b6247 req-b3d5b15c-ff62-4994-ae49-6dde841ab7d8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-f5dc6933-4844-4a0b-9bd3-f045f27b6247 req-b3d5b15c-ff62-4994-ae49-6dde841ab7d8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:37 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-f5dc6933-4844-4a0b-9bd3-f045f27b6247 req-b3d5b15c-ff62-4994-ae49-6dde841ab7d8 service nova] Creating event network-vif-unplugged:903dfac0-8003-4008-b135-5da44763c9ff for instance ba310127-67a9-4245-87f6-555e35f30a16 on user Apr 12 00:37:37 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-f5dc6933-4844-4a0b-9bd3-f045f27b6247 req-b3d5b15c-ff62-4994-ae49-6dde841ab7d8 service nova] Creating event network-vif-plugged:903dfac0-8003-4008-b135-5da44763c9ff for instance ba310127-67a9-4245-87f6-555e35f30a16 on user Apr 12 00:37:37 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-f5dc6933-4844-4a0b-9bd3-f045f27b6247 req-b3d5b15c-ff62-4994-ae49-6dde841ab7d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.046152 Apr 12 00:37:37 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 155/455] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:37:37 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:37:37 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:37 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:37 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:37 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:37 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:37 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:37 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:37 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:37 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Going to try to terminate instance {{(pid=72495) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:37:37 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-95f3c397-eb26-4c86-9dea-0baef6df4dfe tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34" status: 204 len: 0 microversion: 2.1 time: 0.133697 Apr 12 00:37:37 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 150/456] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:37:37 2023] DELETE /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:37:37 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-5720b3fe-0234-49f8-a07f-affa431d3357 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:37 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-5720b3fe-0234-49f8-a07f-affa431d3357 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5720b3fe-0234-49f8-a07f-affa431d3357 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5720b3fe-0234-49f8-a07f-affa431d3357 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5720b3fe-0234-49f8-a07f-affa431d3357 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5720b3fe-0234-49f8-a07f-affa431d3357 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5720b3fe-0234-49f8-a07f-affa431d3357 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5720b3fe-0234-49f8-a07f-affa431d3357 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:38 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-5720b3fe-0234-49f8-a07f-affa431d3357 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5219586e4e24c33a8cdf52c21d875bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12eca8b17b844a8821294ec9dd19de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:37:38 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-5720b3fe-0234-49f8-a07f-affa431d3357 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34" status: 200 len: 1574 microversion: 2.1 time: 0.525841 Apr 12 00:37:38 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 152/457] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:37:37 2023] GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34 => generated 1574 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:39 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-252126fb-b765-42ec-b90b-c9298ab912a1 req-fca02647-9164-4568-80cf-05bea4e85610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa798af-8437-4083-b73c-92b0cb39d861", "tag": "204e9845-040e-4b8d-a957-b70dd44b340b"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:37:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-252126fb-b765-42ec-b90b-c9298ab912a1 req-fca02647-9164-4568-80cf-05bea4e85610 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-252126fb-b765-42ec-b90b-c9298ab912a1 req-fca02647-9164-4568-80cf-05bea4e85610 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-252126fb-b765-42ec-b90b-c9298ab912a1 req-fca02647-9164-4568-80cf-05bea4e85610 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:39 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-252126fb-b765-42ec-b90b-c9298ab912a1 req-fca02647-9164-4568-80cf-05bea4e85610 service nova] Creating event network-changed:204e9845-040e-4b8d-a957-b70dd44b340b for instance daa798af-8437-4083-b73c-92b0cb39d861 on user Apr 12 00:37:39 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-252126fb-b765-42ec-b90b-c9298ab912a1 req-fca02647-9164-4568-80cf-05bea4e85610 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031268 Apr 12 00:37:39 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 156/458] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:37:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:37:39 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-c96c7e4b-bf0c-4270-94cc-05c4dc6b386e req-f1c1ac9d-3096-4913-82e2-c5374b41c258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d67708d-1bcf-4d32-8d45-22376ec72e34", "name": "network-vif-unplugged", "status": "completed", "tag": "71a3bef9-13f4-4aab-ba85-a26faa225efb"}, {"server_uuid": "9d67708d-1bcf-4d32-8d45-22376ec72e34", "name": "network-vif-plugged", "status": "completed", "tag": "71a3bef9-13f4-4aab-ba85-a26faa225efb"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:37:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-c96c7e4b-bf0c-4270-94cc-05c4dc6b386e req-f1c1ac9d-3096-4913-82e2-c5374b41c258 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-c96c7e4b-bf0c-4270-94cc-05c4dc6b386e req-f1c1ac9d-3096-4913-82e2-c5374b41c258 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-c96c7e4b-bf0c-4270-94cc-05c4dc6b386e req-f1c1ac9d-3096-4913-82e2-c5374b41c258 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:39 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-c96c7e4b-bf0c-4270-94cc-05c4dc6b386e req-f1c1ac9d-3096-4913-82e2-c5374b41c258 service nova] Creating event network-vif-unplugged:71a3bef9-13f4-4aab-ba85-a26faa225efb for instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 on user Apr 12 00:37:39 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-c96c7e4b-bf0c-4270-94cc-05c4dc6b386e req-f1c1ac9d-3096-4913-82e2-c5374b41c258 service nova] Creating event network-vif-plugged:71a3bef9-13f4-4aab-ba85-a26faa225efb for instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 on user Apr 12 00:37:39 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-c96c7e4b-bf0c-4270-94cc-05c4dc6b386e req-f1c1ac9d-3096-4913-82e2-c5374b41c258 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.045969 Apr 12 00:37:39 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 151/459] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:37:39 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:37:40 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-c59c26e0-d317-4b78-9b11-39b3d9491469 req-2447f176-e149-463b-a97d-c1afa53a88ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa798af-8437-4083-b73c-92b0cb39d861", "name": "network-vif-plugged", "status": "completed", "tag": "204e9845-040e-4b8d-a957-b70dd44b340b"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:37:40 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-c59c26e0-d317-4b78-9b11-39b3d9491469 req-2447f176-e149-463b-a97d-c1afa53a88ee service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:40 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-c59c26e0-d317-4b78-9b11-39b3d9491469 req-2447f176-e149-463b-a97d-c1afa53a88ee service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:40 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-c59c26e0-d317-4b78-9b11-39b3d9491469 req-2447f176-e149-463b-a97d-c1afa53a88ee service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:40 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-c59c26e0-d317-4b78-9b11-39b3d9491469 req-2447f176-e149-463b-a97d-c1afa53a88ee service nova] Creating event network-vif-plugged:204e9845-040e-4b8d-a957-b70dd44b340b for instance daa798af-8437-4083-b73c-92b0cb39d861 on user Apr 12 00:37:40 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-c59c26e0-d317-4b78-9b11-39b3d9491469 req-2447f176-e149-463b-a97d-c1afa53a88ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029472 Apr 12 00:37:40 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 153/460] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:37:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:37:41 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-e846e6bb-8795-459b-95eb-330e68284a91 req-01c121a8-856a-453b-8416-7d43ff2eb5e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d67708d-1bcf-4d32-8d45-22376ec72e34", "name": "network-vif-deleted", "tag": "71a3bef9-13f4-4aab-ba85-a26faa225efb"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:37:41 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-e846e6bb-8795-459b-95eb-330e68284a91 req-01c121a8-856a-453b-8416-7d43ff2eb5e9 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:41 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-e846e6bb-8795-459b-95eb-330e68284a91 req-01c121a8-856a-453b-8416-7d43ff2eb5e9 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:41 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-e846e6bb-8795-459b-95eb-330e68284a91 req-01c121a8-856a-453b-8416-7d43ff2eb5e9 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:41 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-e846e6bb-8795-459b-95eb-330e68284a91 req-01c121a8-856a-453b-8416-7d43ff2eb5e9 service nova] Creating event network-vif-deleted:71a3bef9-13f4-4aab-ba85-a26faa225efb for instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 on user Apr 12 00:37:41 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-e846e6bb-8795-459b-95eb-330e68284a91 req-01c121a8-856a-453b-8416-7d43ff2eb5e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032614 Apr 12 00:37:41 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 157/461] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:37:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:37:42 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-655500e5-de08-4cc8-ba85-00da5b2468ad req-1a7ad6cd-548f-4ef2-941f-e443ea229693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa798af-8437-4083-b73c-92b0cb39d861", "name": "network-vif-plugged", "status": "completed", "tag": "204e9845-040e-4b8d-a957-b70dd44b340b"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:37:42 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-655500e5-de08-4cc8-ba85-00da5b2468ad req-1a7ad6cd-548f-4ef2-941f-e443ea229693 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:42 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-655500e5-de08-4cc8-ba85-00da5b2468ad req-1a7ad6cd-548f-4ef2-941f-e443ea229693 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:42 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-655500e5-de08-4cc8-ba85-00da5b2468ad req-1a7ad6cd-548f-4ef2-941f-e443ea229693 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:42 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-655500e5-de08-4cc8-ba85-00da5b2468ad req-1a7ad6cd-548f-4ef2-941f-e443ea229693 service nova] Creating event network-vif-plugged:204e9845-040e-4b8d-a957-b70dd44b340b for instance daa798af-8437-4083-b73c-92b0cb39d861 on user Apr 12 00:37:42 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-655500e5-de08-4cc8-ba85-00da5b2468ad req-1a7ad6cd-548f-4ef2-941f-e443ea229693 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039407 Apr 12 00:37:42 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 152/462] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:37:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:37:51 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:37:51 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=14 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:37:51 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=22 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:37:51 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-6851f673-3755-4ae2-8d69-e96445c43521 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:51 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-6851f673-3755-4ae2-8d69-e96445c43521 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-6851f673-3755-4ae2-8d69-e96445c43521 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-6851f673-3755-4ae2-8d69-e96445c43521 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-6851f673-3755-4ae2-8d69-e96445c43521 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-6851f673-3755-4ae2-8d69-e96445c43521 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-6851f673-3755-4ae2-8d69-e96445c43521 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-6851f673-3755-4ae2-8d69-e96445c43521 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:51 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-6851f673-3755-4ae2-8d69-e96445c43521 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048845 Apr 12 00:37:51 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 154/463] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:37:51 2023] GET /compute/v2.1/servers/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:37:51 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:37:51 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:37:51 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:37:51 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:37:51 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-980059856", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "networks": [{"uuid": "d97ca114-f9d6-4141-b129-1e4f8d50b538"}]}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:37:51 user devstack@n-api.service[72496]: DEBUG nova.network.neutron [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] validate_networks() for [('d97ca114-f9d6-4141-b129-1e4f8d50b538', None, None, None, None, None)] {{(pid=72496) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:37:52 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Flavor limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:37:52 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Image limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:37:52 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Flavor pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:37:52 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Image pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:37:52 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:37:52 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:52 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:52 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:52 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:52 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:52 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:52 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Getting quotas for project a8c1003f0d1847b7b4c679b0f7cc3110. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:37:52 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Getting quotas for user c276268b63084515a43caa837af30fb1 and project a8c1003f0d1847b7b4c679b0f7cc3110. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:37:52 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Going to run 1 instances... {{(pid=72496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:37:52 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:37:52 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-99d8499d-a06c-4314-ba45-2f0485adbd75 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.516598 Apr 12 00:37:52 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 158/464] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:37:51 2023] POST /compute/v2.1/servers => generated 378 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:37:52 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:37:52 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:37:52 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-47b8e7a7-49ed-4830-ab75-8964c40c22de tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:52 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-47b8e7a7-49ed-4830-ab75-8964c40c22de tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:52 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-47b8e7a7-49ed-4830-ab75-8964c40c22de tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c276268b63084515a43caa837af30fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c1003f0d1847b7b4c679b0f7cc3110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:37:52 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-47b8e7a7-49ed-4830-ab75-8964c40c22de tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2164441-0fa4-463c-afde-a333095d0e56" status: 200 len: 1211 microversion: 2.1 time: 0.086850 Apr 12 00:37:52 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 153/465] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:37:52 2023] GET /compute/v2.1/servers/f2164441-0fa4-463c-afde-a333095d0e56 => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:37:53 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-982958eb-0d67-4a0c-896e-5653effbba8e tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:53 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-982958eb-0d67-4a0c-896e-5653effbba8e tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] [instance: 19cc71e1-9b01-4bfd-9898-14b04bfe5fff] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:53 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-982958eb-0d67-4a0c-896e-5653effbba8e tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:53 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-982958eb-0d67-4a0c-896e-5653effbba8e tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:53 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-982958eb-0d67-4a0c-896e-5653effbba8e tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:53 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-982958eb-0d67-4a0c-896e-5653effbba8e tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:53 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-982958eb-0d67-4a0c-896e-5653effbba8e tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:53 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-982958eb-0d67-4a0c-896e-5653effbba8e tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:53 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-982958eb-0d67-4a0c-896e-5653effbba8e tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] HTTP exception thrown: Instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff could not be found. Apr 12 00:37:53 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-982958eb-0d67-4a0c-896e-5653effbba8e tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Request method failure captured: Apr 12 00:37:53 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff HTTP/1.1 Apr 12 00:37:53 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:37:53 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:37:53 user devstack@n-api.service[72494]: Connection: close Apr 12 00:37:53 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:37:53 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:37:53 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:37:53 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:37:53 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:37:53 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNfvSj2ZcQeb79xoNqVBwyrAUOg22YtdtnAqWjK0FgYU0TP4Akv5dMchVQoabuW9YUwvQE01qxU8q_2alORbSv5MKKoOBCV6MEuVDthZUo_xxXWtLH0tr7cpXkl0IAqQUikdnYI_fc6UuU5oAyig7EHOGdBEYiUuSE8tEOmkYxE3t9ZI Apr 12 00:37:53 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:37:53 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:37:53 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:37:53 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:37:53 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:37:53 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:37:53 user devstack@n-api.service[72494]: X-Project-Id: b7bc7149e49343889c32fc198b6a0500 Apr 12 00:37:53 user devstack@n-api.service[72494]: X-Project-Name: tempest-TestShelveInstance-431446894 Apr 12 00:37:53 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:37:53 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:37:53 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b7bc7149e49343889c32fc198b6a0500"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b7bc7149e49343889c32fc198b6a0500"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b7bc7149e49343889c32fc198b6a0500"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:37:53 user devstack@n-api.service[72494]: X-Tenant: tempest-TestShelveInstance-431446894 Apr 12 00:37:53 user devstack@n-api.service[72494]: X-Tenant-Id: b7bc7149e49343889c32fc198b6a0500 Apr 12 00:37:53 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-TestShelveInstance-431446894 Apr 12 00:37:53 user devstack@n-api.service[72494]: X-User: tempest-TestShelveInstance-431446894-project-member Apr 12 00:37:53 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:37:53 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:37:53 user devstack@n-api.service[72494]: X-User-Id: 391e2cd0c34b4e838c4cf86ba933270c Apr 12 00:37:53 user devstack@n-api.service[72494]: X-User-Name: tempest-TestShelveInstance-431446894-project-member Apr 12 00:37:53 user devstack@n-api.service[72494]: method: > Apr 12 00:37:53 user devstack@n-api.service[72494]: exception: Instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff could not be found. Apr 12 00:37:53 user devstack@n-api.service[72494]: action_args: {'id': '19cc71e1-9b01-4bfd-9898-14b04bfe5fff'} Apr 12 00:37:53 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff could not be found. Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff could not be found. Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff could not be found. Apr 12 00:37:53 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:37:53 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-982958eb-0d67-4a0c-896e-5653effbba8e tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Returning 404 to user: Instance 19cc71e1-9b01-4bfd-9898-14b04bfe5fff could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:37:53 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-982958eb-0d67-4a0c-896e-5653effbba8e tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff" status: 404 len: 111 microversion: 2.1 time: 0.030896 Apr 12 00:37:53 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 155/466] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:37:53 2023] GET /compute/v2.1/servers/19cc71e1-9b01-4bfd-9898-14b04bfe5fff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:37:54 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-f5f2f1b0-8307-4b13-97da-10cd9340e5c0 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] Calling method '.version_select at 0x7f7cd46725f0>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:54 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-f5f2f1b0-8307-4b13-97da-10cd9340e5c0 tempest-TestShelveInstance-431446894 tempest-TestShelveInstance-431446894-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-382306594" status: 202 len: 0 microversion: 2.1 time: 0.030318 Apr 12 00:37:54 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 159/467] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 00:37:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-382306594 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:37:55 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-16226ff7-0481-4941-961a-6c9e59d24be1 req-03e2bd47-19bc-457c-ba37-944dc7fdf8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2164441-0fa4-463c-afde-a333095d0e56", "tag": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:37:55 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-16226ff7-0481-4941-961a-6c9e59d24be1 req-03e2bd47-19bc-457c-ba37-944dc7fdf8b8 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:55 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-16226ff7-0481-4941-961a-6c9e59d24be1 req-03e2bd47-19bc-457c-ba37-944dc7fdf8b8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:55 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-16226ff7-0481-4941-961a-6c9e59d24be1 req-03e2bd47-19bc-457c-ba37-944dc7fdf8b8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:55 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-16226ff7-0481-4941-961a-6c9e59d24be1 req-03e2bd47-19bc-457c-ba37-944dc7fdf8b8 service nova] Creating event network-changed:6b36ad5a-353d-438b-95d1-fddbcfe01e2c for instance f2164441-0fa4-463c-afde-a333095d0e56 on user Apr 12 00:37:55 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-16226ff7-0481-4941-961a-6c9e59d24be1 req-03e2bd47-19bc-457c-ba37-944dc7fdf8b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040079 Apr 12 00:37:55 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 154/468] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:37:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:37:55 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-a1875253-4ffe-4574-9a86-e06863a390c7 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:55 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-a1875253-4ffe-4574-9a86-e06863a390c7 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: 6c1ae397-d28d-4143-9aa1-cf00e799f9b5] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:55 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a1875253-4ffe-4574-9a86-e06863a390c7 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:55 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a1875253-4ffe-4574-9a86-e06863a390c7 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:55 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a1875253-4ffe-4574-9a86-e06863a390c7 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:55 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a1875253-4ffe-4574-9a86-e06863a390c7 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:55 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a1875253-4ffe-4574-9a86-e06863a390c7 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:55 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a1875253-4ffe-4574-9a86-e06863a390c7 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:55 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-a1875253-4ffe-4574-9a86-e06863a390c7 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] HTTP exception thrown: Instance 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 could not be found. Apr 12 00:37:55 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-a1875253-4ffe-4574-9a86-e06863a390c7 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Request method failure captured: Apr 12 00:37:55 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/6c1ae397-d28d-4143-9aa1-cf00e799f9b5 HTTP/1.1 Apr 12 00:37:55 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:37:55 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:37:55 user devstack@n-api.service[72494]: Connection: close Apr 12 00:37:55 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:37:55 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:37:55 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:37:55 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:37:55 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:37:55 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNfuzV55VWUE3JdVtifhFJCNnP1Bgsb7r2GxdEYXwNXLiUDtWA4ch6eL2vyvz9lSmVsG4O-6l7yqdwxbxyzMzx0e6JdWHktH5EVWtzkMLFO_UD8JNWkKI2Ag996GuHrBhyU17TxUiO7R9WsYOLl42Gfwej0nl6kqcdoNBd61GIivKtZQ Apr 12 00:37:55 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:37:55 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:37:55 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:37:55 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:37:55 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:37:55 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:37:55 user devstack@n-api.service[72494]: X-Project-Id: ca0ea21a2d4d400cba79444c68b58aed Apr 12 00:37:55 user devstack@n-api.service[72494]: X-Project-Name: tempest-TestStampPattern-628358733 Apr 12 00:37:55 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:37:55 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:37:55 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ca0ea21a2d4d400cba79444c68b58aed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ca0ea21a2d4d400cba79444c68b58aed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ca0ea21a2d4d400cba79444c68b58aed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:37:55 user devstack@n-api.service[72494]: X-Tenant: tempest-TestStampPattern-628358733 Apr 12 00:37:55 user devstack@n-api.service[72494]: X-Tenant-Id: ca0ea21a2d4d400cba79444c68b58aed Apr 12 00:37:55 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-TestStampPattern-628358733 Apr 12 00:37:55 user devstack@n-api.service[72494]: X-User: tempest-TestStampPattern-628358733-project-member Apr 12 00:37:55 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:37:55 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:37:55 user devstack@n-api.service[72494]: X-User-Id: 0e843a45549943cb88b1b3123a2fbe8a Apr 12 00:37:55 user devstack@n-api.service[72494]: X-User-Name: tempest-TestStampPattern-628358733-project-member Apr 12 00:37:55 user devstack@n-api.service[72494]: method: > Apr 12 00:37:55 user devstack@n-api.service[72494]: exception: Instance 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 could not be found. Apr 12 00:37:55 user devstack@n-api.service[72494]: action_args: {'id': '6c1ae397-d28d-4143-9aa1-cf00e799f9b5'} Apr 12 00:37:55 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 could not be found. Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 could not be found. Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 could not be found. Apr 12 00:37:55 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:37:55 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-a1875253-4ffe-4574-9a86-e06863a390c7 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Returning 404 to user: Instance 6c1ae397-d28d-4143-9aa1-cf00e799f9b5 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:37:55 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-a1875253-4ffe-4574-9a86-e06863a390c7 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c1ae397-d28d-4143-9aa1-cf00e799f9b5" status: 404 len: 111 microversion: 2.1 time: 0.029934 Apr 12 00:37:55 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 156/469] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:37:55 2023] GET /compute/v2.1/servers/6c1ae397-d28d-4143-9aa1-cf00e799f9b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:37:58 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-098162e8-1838-4ab4-850e-b7d72f6d0ca1 req-28c2fbe3-355b-495a-a56d-d58bd7810083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2164441-0fa4-463c-afde-a333095d0e56", "name": "network-vif-plugged", "status": "completed", "tag": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:37:58 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-098162e8-1838-4ab4-850e-b7d72f6d0ca1 req-28c2fbe3-355b-495a-a56d-d58bd7810083 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:58 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-098162e8-1838-4ab4-850e-b7d72f6d0ca1 req-28c2fbe3-355b-495a-a56d-d58bd7810083 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:58 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-098162e8-1838-4ab4-850e-b7d72f6d0ca1 req-28c2fbe3-355b-495a-a56d-d58bd7810083 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:58 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-098162e8-1838-4ab4-850e-b7d72f6d0ca1 req-28c2fbe3-355b-495a-a56d-d58bd7810083 service nova] Creating event network-vif-plugged:6b36ad5a-353d-438b-95d1-fddbcfe01e2c for instance f2164441-0fa4-463c-afde-a333095d0e56 on user Apr 12 00:37:58 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-098162e8-1838-4ab4-850e-b7d72f6d0ca1 req-28c2fbe3-355b-495a-a56d-d58bd7810083 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033228 Apr 12 00:37:58 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 160/470] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:37:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:37:59 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-ed1abcd2-23fa-4c5e-99f2-8487ff25f230 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:37:59 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-ed1abcd2-23fa-4c5e-99f2-8487ff25f230 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:37:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ed1abcd2-23fa-4c5e-99f2-8487ff25f230 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ed1abcd2-23fa-4c5e-99f2-8487ff25f230 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ed1abcd2-23fa-4c5e-99f2-8487ff25f230 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ed1abcd2-23fa-4c5e-99f2-8487ff25f230 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:37:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ed1abcd2-23fa-4c5e-99f2-8487ff25f230 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:37:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ed1abcd2-23fa-4c5e-99f2-8487ff25f230 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:37:59 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-ed1abcd2-23fa-4c5e-99f2-8487ff25f230 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] HTTP exception thrown: Instance d25bc2e7-3399-47be-b78d-990acbb51749 is not attached to volume e3d41b83-29fb-497c-b972-2dc29864ff1f Apr 12 00:37:59 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-ed1abcd2-23fa-4c5e-99f2-8487ff25f230 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Request method failure captured: Apr 12 00:37:59 user devstack@n-api.service[72495]: request: DELETE /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749/os-volume_attachments/e3d41b83-29fb-497c-b972-2dc29864ff1f HTTP/1.1 Apr 12 00:37:59 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:37:59 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:37:59 user devstack@n-api.service[72495]: Connection: close Apr 12 00:37:59 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 00:37:59 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:37:59 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:37:59 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:37:59 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:37:59 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNfuzV55VWUE3JdVtifhFJCNnP1Bgsb7r2GxdEYXwNXLiUDtWA4ch6eL2vyvz9lSmVsG4O-6l7yqdwxbxyzMzx0e6JdWHktH5EVWtzkMLFO_UD8JNWkKI2Ag996GuHrBhyU17TxUiO7R9WsYOLl42Gfwej0nl6kqcdoNBd61GIivKtZQ Apr 12 00:37:59 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:37:59 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:37:59 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:37:59 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:37:59 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:37:59 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:37:59 user devstack@n-api.service[72495]: X-Project-Id: ca0ea21a2d4d400cba79444c68b58aed Apr 12 00:37:59 user devstack@n-api.service[72495]: X-Project-Name: tempest-TestStampPattern-628358733 Apr 12 00:37:59 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:37:59 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:37:59 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ca0ea21a2d4d400cba79444c68b58aed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ca0ea21a2d4d400cba79444c68b58aed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ca0ea21a2d4d400cba79444c68b58aed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:37:59 user devstack@n-api.service[72495]: X-Tenant: tempest-TestStampPattern-628358733 Apr 12 00:37:59 user devstack@n-api.service[72495]: X-Tenant-Id: ca0ea21a2d4d400cba79444c68b58aed Apr 12 00:37:59 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-TestStampPattern-628358733 Apr 12 00:37:59 user devstack@n-api.service[72495]: X-User: tempest-TestStampPattern-628358733-project-member Apr 12 00:37:59 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:37:59 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:37:59 user devstack@n-api.service[72495]: X-User-Id: 0e843a45549943cb88b1b3123a2fbe8a Apr 12 00:37:59 user devstack@n-api.service[72495]: X-User-Name: tempest-TestStampPattern-628358733-project-member Apr 12 00:37:59 user devstack@n-api.service[72495]: method: > Apr 12 00:37:59 user devstack@n-api.service[72495]: exception: Instance d25bc2e7-3399-47be-b78d-990acbb51749 is not attached to volume e3d41b83-29fb-497c-b972-2dc29864ff1f Apr 12 00:37:59 user devstack@n-api.service[72495]: action_args: {'server_id': 'd25bc2e7-3399-47be-b78d-990acbb51749', 'id': 'e3d41b83-29fb-497c-b972-2dc29864ff1f'} Apr 12 00:37:59 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e3d41b83-29fb-497c-b972-2dc29864ff1f. Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d25bc2e7-3399-47be-b78d-990acbb51749 is not attached to volume e3d41b83-29fb-497c-b972-2dc29864ff1f Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d25bc2e7-3399-47be-b78d-990acbb51749 is not attached to volume e3d41b83-29fb-497c-b972-2dc29864ff1f Apr 12 00:37:59 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:37:59 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-ed1abcd2-23fa-4c5e-99f2-8487ff25f230 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Returning 404 to user: Instance d25bc2e7-3399-47be-b78d-990acbb51749 is not attached to volume e3d41b83-29fb-497c-b972-2dc29864ff1f {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:37:59 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-ed1abcd2-23fa-4c5e-99f2-8487ff25f230 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749/os-volume_attachments/e3d41b83-29fb-497c-b972-2dc29864ff1f" status: 404 len: 154 microversion: 2.1 time: 0.092054 Apr 12 00:37:59 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 155/471] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 00:37:59 2023] DELETE /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749/os-volume_attachments/e3d41b83-29fb-497c-b972-2dc29864ff1f => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:38:00 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:00 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:00 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-2532b6ea-8872-401f-bdc2-203fcd6f5b8b req-4d370cd1-02db-46b9-9a00-fa046af1b280 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25bc2e7-3399-47be-b78d-990acbb51749", "tag": "7f434880-804b-43da-b1ab-5d5e05b5bee1"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:00 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:00 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:00 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:00 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:00 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:00 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2532b6ea-8872-401f-bdc2-203fcd6f5b8b req-4d370cd1-02db-46b9-9a00-fa046af1b280 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2532b6ea-8872-401f-bdc2-203fcd6f5b8b req-4d370cd1-02db-46b9-9a00-fa046af1b280 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2532b6ea-8872-401f-bdc2-203fcd6f5b8b req-4d370cd1-02db-46b9-9a00-fa046af1b280 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:00 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-2532b6ea-8872-401f-bdc2-203fcd6f5b8b req-4d370cd1-02db-46b9-9a00-fa046af1b280 service nova] Creating event network-changed:7f434880-804b-43da-b1ab-5d5e05b5bee1 for instance d25bc2e7-3399-47be-b78d-990acbb51749 on user Apr 12 00:38:00 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-2532b6ea-8872-401f-bdc2-203fcd6f5b8b req-4d370cd1-02db-46b9-9a00-fa046af1b280 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035003 Apr 12 00:38:00 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 161/472] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:38:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:00 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Going to try to terminate instance {{(pid=72494) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:38:00 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-97f54ecf-0cb4-4a74-8598-5df6719ce69e tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749" status: 204 len: 0 microversion: 2.1 time: 0.149484 Apr 12 00:38:00 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 157/473] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:38:00 2023] DELETE /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:38:00 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-8c77a20e-01a0-4f28-a46a-69cc0c62d76a tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:00 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-8c77a20e-01a0-4f28-a46a-69cc0c62d76a tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:00 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8c77a20e-01a0-4f28-a46a-69cc0c62d76a tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:00 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8c77a20e-01a0-4f28-a46a-69cc0c62d76a tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:00 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8c77a20e-01a0-4f28-a46a-69cc0c62d76a tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:00 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8c77a20e-01a0-4f28-a46a-69cc0c62d76a tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:00 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8c77a20e-01a0-4f28-a46a-69cc0c62d76a tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:00 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8c77a20e-01a0-4f28-a46a-69cc0c62d76a tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:00 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-8c77a20e-01a0-4f28-a46a-69cc0c62d76a tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e843a45549943cb88b1b3123a2fbe8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0ea21a2d4d400cba79444c68b58aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:38:00 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-8c77a20e-01a0-4f28-a46a-69cc0c62d76a tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749" status: 200 len: 1663 microversion: 2.1 time: 0.215200 Apr 12 00:38:00 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 156/474] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:38:00 2023] GET /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749 => generated 1663 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:00 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-3d52cb0e-2556-42c0-95bb-c610d6b1747a req-6e24c31c-ed64-4454-80aa-fa376c827b20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2164441-0fa4-463c-afde-a333095d0e56", "name": "network-vif-plugged", "status": "completed", "tag": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-3d52cb0e-2556-42c0-95bb-c610d6b1747a req-6e24c31c-ed64-4454-80aa-fa376c827b20 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-3d52cb0e-2556-42c0-95bb-c610d6b1747a req-6e24c31c-ed64-4454-80aa-fa376c827b20 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-3d52cb0e-2556-42c0-95bb-c610d6b1747a req-6e24c31c-ed64-4454-80aa-fa376c827b20 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:00 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-3d52cb0e-2556-42c0-95bb-c610d6b1747a req-6e24c31c-ed64-4454-80aa-fa376c827b20 service nova] Creating event network-vif-plugged:6b36ad5a-353d-438b-95d1-fddbcfe01e2c for instance f2164441-0fa4-463c-afde-a333095d0e56 on user Apr 12 00:38:00 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-3d52cb0e-2556-42c0-95bb-c610d6b1747a req-6e24c31c-ed64-4454-80aa-fa376c827b20 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031384 Apr 12 00:38:00 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 162/475] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:38:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:01 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-3d3c6f50-a24d-4e4c-beb1-0b1afeeb6a29 req-9931cd53-eec6-49cd-b96b-5266dc0dea77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25bc2e7-3399-47be-b78d-990acbb51749", "name": "network-vif-deleted", "tag": "7f434880-804b-43da-b1ab-5d5e05b5bee1"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-3d3c6f50-a24d-4e4c-beb1-0b1afeeb6a29 req-9931cd53-eec6-49cd-b96b-5266dc0dea77 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-3d3c6f50-a24d-4e4c-beb1-0b1afeeb6a29 req-9931cd53-eec6-49cd-b96b-5266dc0dea77 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-3d3c6f50-a24d-4e4c-beb1-0b1afeeb6a29 req-9931cd53-eec6-49cd-b96b-5266dc0dea77 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:01 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-3d3c6f50-a24d-4e4c-beb1-0b1afeeb6a29 req-9931cd53-eec6-49cd-b96b-5266dc0dea77 service nova] Creating event network-vif-deleted:7f434880-804b-43da-b1ab-5d5e05b5bee1 for instance d25bc2e7-3399-47be-b78d-990acbb51749 on user Apr 12 00:38:01 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-3d3c6f50-a24d-4e4c-beb1-0b1afeeb6a29 req-9931cd53-eec6-49cd-b96b-5266dc0dea77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049079 Apr 12 00:38:01 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 158/476] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:38:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:38:02 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-52702ec7-9040-4457-a79f-7343322cfb7e req-d1625af6-48ee-4994-909e-86c369fe0c02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25bc2e7-3399-47be-b78d-990acbb51749", "name": "network-vif-unplugged", "status": "completed", "tag": "7f434880-804b-43da-b1ab-5d5e05b5bee1"}, {"server_uuid": "d25bc2e7-3399-47be-b78d-990acbb51749", "name": "network-vif-plugged", "status": "completed", "tag": "7f434880-804b-43da-b1ab-5d5e05b5bee1"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:02 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-52702ec7-9040-4457-a79f-7343322cfb7e req-d1625af6-48ee-4994-909e-86c369fe0c02 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:02 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-52702ec7-9040-4457-a79f-7343322cfb7e req-d1625af6-48ee-4994-909e-86c369fe0c02 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:02 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-52702ec7-9040-4457-a79f-7343322cfb7e req-d1625af6-48ee-4994-909e-86c369fe0c02 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:02 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-52702ec7-9040-4457-a79f-7343322cfb7e req-d1625af6-48ee-4994-909e-86c369fe0c02 service nova] Creating event network-vif-unplugged:7f434880-804b-43da-b1ab-5d5e05b5bee1 for instance d25bc2e7-3399-47be-b78d-990acbb51749 on user Apr 12 00:38:02 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-52702ec7-9040-4457-a79f-7343322cfb7e req-d1625af6-48ee-4994-909e-86c369fe0c02 service nova] Creating event network-vif-plugged:7f434880-804b-43da-b1ab-5d5e05b5bee1 for instance d25bc2e7-3399-47be-b78d-990acbb51749 on user Apr 12 00:38:02 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-52702ec7-9040-4457-a79f-7343322cfb7e req-d1625af6-48ee-4994-909e-86c369fe0c02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032134 Apr 12 00:38:02 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 157/477] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:38:02 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:38:05 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:38:05 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:38:05 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-fa907abe-42a9-484d-bab7-a4cbe5b10454 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:05 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-fa907abe-42a9-484d-bab7-a4cbe5b10454 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fa907abe-42a9-484d-bab7-a4cbe5b10454 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fa907abe-42a9-484d-bab7-a4cbe5b10454 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fa907abe-42a9-484d-bab7-a4cbe5b10454 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fa907abe-42a9-484d-bab7-a4cbe5b10454 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fa907abe-42a9-484d-bab7-a4cbe5b10454 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fa907abe-42a9-484d-bab7-a4cbe5b10454 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:06 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-fa907abe-42a9-484d-bab7-a4cbe5b10454 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8fd7bb9c-9e20-49f2-8848-162a784b9885/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.121592 Apr 12 00:38:06 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 163/478] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 00:38:05 2023] GET /compute/v2.1/servers/8fd7bb9c-9e20-49f2-8848-162a784b9885/os-interface => generated 283 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:06 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-ccee83ef-b084-4310-b7b4-70ebb76ae6e4 req-3970571a-b70f-434f-b8ed-4fae0763bf0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fd7bb9c-9e20-49f2-8848-162a784b9885", "tag": "4e105e43-5ee4-46ca-a01a-be1a58096a0a"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:06 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-ccee83ef-b084-4310-b7b4-70ebb76ae6e4 req-3970571a-b70f-434f-b8ed-4fae0763bf0f service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:06 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-ccee83ef-b084-4310-b7b4-70ebb76ae6e4 req-3970571a-b70f-434f-b8ed-4fae0763bf0f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:06 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-ccee83ef-b084-4310-b7b4-70ebb76ae6e4 req-3970571a-b70f-434f-b8ed-4fae0763bf0f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:06 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-ccee83ef-b084-4310-b7b4-70ebb76ae6e4 req-3970571a-b70f-434f-b8ed-4fae0763bf0f service nova] Creating event network-changed:4e105e43-5ee4-46ca-a01a-be1a58096a0a for instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 on user Apr 12 00:38:06 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-ccee83ef-b084-4310-b7b4-70ebb76ae6e4 req-3970571a-b70f-434f-b8ed-4fae0763bf0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030828 Apr 12 00:38:06 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 159/479] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:38:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:07 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:38:07 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-9679d317-a51f-4f46-8540-bd1c0e7d170c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:07 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-9679d317-a51f-4f46-8540-bd1c0e7d170c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:07 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9679d317-a51f-4f46-8540-bd1c0e7d170c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:07 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9679d317-a51f-4f46-8540-bd1c0e7d170c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:07 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9679d317-a51f-4f46-8540-bd1c0e7d170c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:07 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9679d317-a51f-4f46-8540-bd1c0e7d170c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:07 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9679d317-a51f-4f46-8540-bd1c0e7d170c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:07 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9679d317-a51f-4f46-8540-bd1c0e7d170c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:07 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-9679d317-a51f-4f46-8540-bd1c0e7d170c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8fd7bb9c-9e20-49f2-8848-162a784b9885/ips" status: 200 len: 148 microversion: 2.1 time: 0.046368 Apr 12 00:38:08 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 158/480] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 00:38:07 2023] GET /compute/v2.1/servers/8fd7bb9c-9e20-49f2-8848-162a784b9885/ips => generated 148 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:08 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-fbb29e77-8972-4b4c-9a56-100979816062 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04e2cfac-63fa-480c-a8bd-f583809971ab"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:08 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-fbb29e77-8972-4b4c-9a56-100979816062 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fbb29e77-8972-4b4c-9a56-100979816062 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fbb29e77-8972-4b4c-9a56-100979816062 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fbb29e77-8972-4b4c-9a56-100979816062 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fbb29e77-8972-4b4c-9a56-100979816062 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fbb29e77-8972-4b4c-9a56-100979816062 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fbb29e77-8972-4b4c-9a56-100979816062 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:08 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-fbb29e77-8972-4b4c-9a56-100979816062 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] HTTP exception thrown: Invalid volume: volume 04e2cfac-63fa-480c-a8bd-f583809971ab is already attached to instances: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a Apr 12 00:38:08 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-fbb29e77-8972-4b4c-9a56-100979816062 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Request method failure captured: Apr 12 00:38:08 user devstack@n-api.service[72496]: request: POST /compute/v2.1/servers/8fd7bb9c-9e20-49f2-8848-162a784b9885/os-volume_attachments HTTP/1.1 Apr 12 00:38:08 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:38:08 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:38:08 user devstack@n-api.service[72496]: Connection: close Apr 12 00:38:08 user devstack@n-api.service[72496]: Content-Length: 74 Apr 12 00:38:08 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:38:08 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:38:08 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:38:08 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:38:08 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNfx-yPB8Addd9whxbTRQOdN90sGir-xfc1IiR7-ECw56svld7JonHx7axp9WUmnT4KzR5TFzU-_uCRK58QPK_z1_aUm3UKF-xkJbrjTzJI02gd86EhzUOHFXsNSRIvLDd7tPEw_YsNig7FJnlwWFmOoZQqpImrudgWYdjbdfFy26et4 Apr 12 00:38:08 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:38:08 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:38:08 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:38:08 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:38:08 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:38:08 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:38:08 user devstack@n-api.service[72496]: X-Project-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:38:08 user devstack@n-api.service[72496]: X-Project-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:38:08 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:38:08 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:38:08 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b56f3c567dc84773a33d596920df727a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:38:08 user devstack@n-api.service[72496]: X-Tenant: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:38:08 user devstack@n-api.service[72496]: X-Tenant-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:38:08 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:38:08 user devstack@n-api.service[72496]: X-User: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:38:08 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:38:08 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:38:08 user devstack@n-api.service[72496]: X-User-Id: d373f582479c441e8ce9849ca694a186 Apr 12 00:38:08 user devstack@n-api.service[72496]: X-User-Name: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:38:08 user devstack@n-api.service[72496]: Apr 12 00:38:08 user devstack@n-api.service[72496]: {"volumeAttachment": {"volumeId": "04e2cfac-63fa-480c-a8bd-f583809971ab"}} Apr 12 00:38:08 user devstack@n-api.service[72496]: method: > Apr 12 00:38:08 user devstack@n-api.service[72496]: exception: Invalid volume: volume 04e2cfac-63fa-480c-a8bd-f583809971ab is already attached to instances: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a Apr 12 00:38:08 user devstack@n-api.service[72496]: action_args: {'server_id': '8fd7bb9c-9e20-49f2-8848-162a784b9885', 'body': {'volumeAttachment': {'volumeId': '04e2cfac-63fa-480c-a8bd-f583809971ab'}}} Apr 12 00:38:08 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 04e2cfac-63fa-480c-a8bd-f583809971ab is already attached to instances: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 04e2cfac-63fa-480c-a8bd-f583809971ab is already attached to instances: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 04e2cfac-63fa-480c-a8bd-f583809971ab is already attached to instances: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a Apr 12 00:38:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:38:08 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-fbb29e77-8972-4b4c-9a56-100979816062 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Returning 400 to user: Invalid volume: volume 04e2cfac-63fa-480c-a8bd-f583809971ab is already attached to instances: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:38:08 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-fbb29e77-8972-4b4c-9a56-100979816062 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8fd7bb9c-9e20-49f2-8848-162a784b9885/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092876 Apr 12 00:38:08 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 164/481] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 00:38:08 2023] POST /compute/v2.1/servers/8fd7bb9c-9e20-49f2-8848-162a784b9885/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:38:08 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:08 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:08 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:08 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:08 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:08 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:08 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:08 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:08 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Going to try to terminate instance {{(pid=72494) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:38:08 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-e5955bde-7938-49cb-88a6-80c535296dc2 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8fd7bb9c-9e20-49f2-8848-162a784b9885" status: 204 len: 0 microversion: 2.1 time: 0.119223 Apr 12 00:38:08 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 160/482] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:38:08 2023] DELETE /compute/v2.1/servers/8fd7bb9c-9e20-49f2-8848-162a784b9885 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:38:08 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-ad0c152e-a4ed-4116-a627-d14ac1e34f02 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:08 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-ad0c152e-a4ed-4116-a627-d14ac1e34f02 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ad0c152e-a4ed-4116-a627-d14ac1e34f02 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ad0c152e-a4ed-4116-a627-d14ac1e34f02 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ad0c152e-a4ed-4116-a627-d14ac1e34f02 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ad0c152e-a4ed-4116-a627-d14ac1e34f02 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ad0c152e-a4ed-4116-a627-d14ac1e34f02 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-ad0c152e-a4ed-4116-a627-d14ac1e34f02 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:08 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-ad0c152e-a4ed-4116-a627-d14ac1e34f02 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373f582479c441e8ce9849ca694a186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f3c567dc84773a33d596920df727a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:38:08 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-ad0c152e-a4ed-4116-a627-d14ac1e34f02 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8fd7bb9c-9e20-49f2-8848-162a784b9885" status: 200 len: 1669 microversion: 2.1 time: 0.168478 Apr 12 00:38:08 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 159/483] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:38:08 2023] GET /compute/v2.1/servers/8fd7bb9c-9e20-49f2-8848-162a784b9885 => generated 1669 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:08 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-f08e34c5-07fb-42d7-8e4e-e0292c3ccc80 req-5185b606-b8d6-48e1-a861-847bd85fef5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fd7bb9c-9e20-49f2-8848-162a784b9885", "name": "network-vif-unplugged", "status": "completed", "tag": "4e105e43-5ee4-46ca-a01a-be1a58096a0a"}, {"server_uuid": "8fd7bb9c-9e20-49f2-8848-162a784b9885", "name": "network-vif-plugged", "status": "completed", "tag": "4e105e43-5ee4-46ca-a01a-be1a58096a0a"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-f08e34c5-07fb-42d7-8e4e-e0292c3ccc80 req-5185b606-b8d6-48e1-a861-847bd85fef5f service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-f08e34c5-07fb-42d7-8e4e-e0292c3ccc80 req-5185b606-b8d6-48e1-a861-847bd85fef5f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-f08e34c5-07fb-42d7-8e4e-e0292c3ccc80 req-5185b606-b8d6-48e1-a861-847bd85fef5f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:08 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-f08e34c5-07fb-42d7-8e4e-e0292c3ccc80 req-5185b606-b8d6-48e1-a861-847bd85fef5f service nova] Creating event network-vif-unplugged:4e105e43-5ee4-46ca-a01a-be1a58096a0a for instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 on user Apr 12 00:38:08 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-f08e34c5-07fb-42d7-8e4e-e0292c3ccc80 req-5185b606-b8d6-48e1-a861-847bd85fef5f service nova] Creating event network-vif-plugged:4e105e43-5ee4-46ca-a01a-be1a58096a0a for instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 on user Apr 12 00:38:08 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-f08e34c5-07fb-42d7-8e4e-e0292c3ccc80 req-5185b606-b8d6-48e1-a861-847bd85fef5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.027597 Apr 12 00:38:08 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 165/484] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:38:08 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:10 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-eb56701d-b1b0-4ce7-9500-0912911ab6b2 req-3d99101b-39a3-4222-a61f-09738bb44d64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fd7bb9c-9e20-49f2-8848-162a784b9885", "name": "network-vif-deleted", "tag": "4e105e43-5ee4-46ca-a01a-be1a58096a0a"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:10 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-eb56701d-b1b0-4ce7-9500-0912911ab6b2 req-3d99101b-39a3-4222-a61f-09738bb44d64 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:10 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-eb56701d-b1b0-4ce7-9500-0912911ab6b2 req-3d99101b-39a3-4222-a61f-09738bb44d64 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:10 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-eb56701d-b1b0-4ce7-9500-0912911ab6b2 req-3d99101b-39a3-4222-a61f-09738bb44d64 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:11 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-eb56701d-b1b0-4ce7-9500-0912911ab6b2 req-3d99101b-39a3-4222-a61f-09738bb44d64 service nova] Creating event network-vif-deleted:4e105e43-5ee4-46ca-a01a-be1a58096a0a for instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 on user Apr 12 00:38:11 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-eb56701d-b1b0-4ce7-9500-0912911ab6b2 req-3d99101b-39a3-4222-a61f-09738bb44d64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031897 Apr 12 00:38:11 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 161/485] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:38:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:16 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-f0c31b9c-4eb4-4332-8137-566896a90d2a tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Action: 'create', calling method: .version_select at 0x7f7cd4764670>, body: {"keypair": {"name": "tempest-keypair-936664235", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfcEUBZp/r0Qr+iXZ7VL0L/sg/DlCeGc9XiO7Mbog1Rn8MLmZsv660DZ2ywYiThGWPYBU7SmwQ5EYhiLYCMFIdiItGknXyBfY++d6oZR6/JM9QXgkOzqORWBqeFGCztcw=="}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:16 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-f0c31b9c-4eb4-4332-8137-566896a90d2a tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Getting quotas for project fcf1fea74ef143e6b394e41e7c4ed495. Resources: {'key_pairs'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:38:16 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-f0c31b9c-4eb4-4332-8137-566896a90d2a tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Getting quotas for user 6b9421443b2f421298a934122c6a8b8c and project fcf1fea74ef143e6b394e41e7c4ed495. Resources: {'key_pairs'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:38:16 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-f0c31b9c-4eb4-4332-8137-566896a90d2a tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.069814 Apr 12 00:38:16 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 160/486] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 00:38:16 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:18 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1581384647", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "2672ea92-a779-4d3e-8b39-13317b97c3a7"}], "security_groups": [{"name": "tempest-securitygroup--379211929"}], "key_name": "tempest-keypair-936664235", "user_data": "}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:18 user devstack@n-api.service[72496]: DEBUG nova.network.neutron [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] validate_networks() for [('2672ea92-a779-4d3e-8b39-13317b97c3a7', None, None, None, None, None)] {{(pid=72496) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:38:18 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Flavor limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:38:18 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Image limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:38:18 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Flavor pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:38:18 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Image pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:38:18 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:38:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:18 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Getting quotas for project fcf1fea74ef143e6b394e41e7c4ed495. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:38:18 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Getting quotas for user 6b9421443b2f421298a934122c6a8b8c and project fcf1fea74ef143e6b394e41e7c4ed495. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:38:18 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Going to run 1 instances... {{(pid=72496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:38:18 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:38:18 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-e5b9c23d-6b43-4a70-9c2b-1870f8defcf2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.554419 Apr 12 00:38:18 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 166/487] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:38:18 2023] POST /compute/v2.1/servers => generated 406 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:38:18 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-d865373a-727f-429e-841c-b950393be0a6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:18 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-d865373a-727f-429e-841c-b950393be0a6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:18 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-d865373a-727f-429e-841c-b950393be0a6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9421443b2f421298a934122c6a8b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf1fea74ef143e6b394e41e7c4ed495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:38:18 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-d865373a-727f-429e-841c-b950393be0a6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d" status: 200 len: 1239 microversion: 2.1 time: 0.082587 Apr 12 00:38:18 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 162/488] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:38:18 2023] GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d => generated 1239 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:21 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=26 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:38:21 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-36701a29-cc51-46a0-b47a-083da7ac4de5 req-c674a9a8-3f55-45cc-be40-5f4981dbbea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49c8e8b7-1f91-4cf5-a222-c787a186444d", "tag": "a2a25522-be49-4ac7-9893-d030dc2d87ab"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-36701a29-cc51-46a0-b47a-083da7ac4de5 req-c674a9a8-3f55-45cc-be40-5f4981dbbea9 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-36701a29-cc51-46a0-b47a-083da7ac4de5 req-c674a9a8-3f55-45cc-be40-5f4981dbbea9 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-36701a29-cc51-46a0-b47a-083da7ac4de5 req-c674a9a8-3f55-45cc-be40-5f4981dbbea9 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:21 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-36701a29-cc51-46a0-b47a-083da7ac4de5 req-c674a9a8-3f55-45cc-be40-5f4981dbbea9 service nova] Creating event network-changed:a2a25522-be49-4ac7-9893-d030dc2d87ab for instance 49c8e8b7-1f91-4cf5-a222-c787a186444d on user Apr 12 00:38:21 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-36701a29-cc51-46a0-b47a-083da7ac4de5 req-c674a9a8-3f55-45cc-be40-5f4981dbbea9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033137 Apr 12 00:38:21 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 161/489] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:38:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:23 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-a5bcf081-3da7-437a-b5f1-80819fe95734 req-e58d2449-53be-43a1-b7f1-2b56716ec65f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c8e8b7-1f91-4cf5-a222-c787a186444d", "name": "network-vif-plugged", "status": "completed", "tag": "a2a25522-be49-4ac7-9893-d030dc2d87ab"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:23 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:38:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-a5bcf081-3da7-437a-b5f1-80819fe95734 req-e58d2449-53be-43a1-b7f1-2b56716ec65f service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-a5bcf081-3da7-437a-b5f1-80819fe95734 req-e58d2449-53be-43a1-b7f1-2b56716ec65f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-a5bcf081-3da7-437a-b5f1-80819fe95734 req-e58d2449-53be-43a1-b7f1-2b56716ec65f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:23 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=23 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:38:23 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-a5bcf081-3da7-437a-b5f1-80819fe95734 req-e58d2449-53be-43a1-b7f1-2b56716ec65f service nova] Creating event network-vif-plugged:a2a25522-be49-4ac7-9893-d030dc2d87ab for instance 49c8e8b7-1f91-4cf5-a222-c787a186444d on user Apr 12 00:38:23 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-a5bcf081-3da7-437a-b5f1-80819fe95734 req-e58d2449-53be-43a1-b7f1-2b56716ec65f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051711 Apr 12 00:38:23 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 167/490] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:38:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:24 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:38:24 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-e47e152e-ddff-47f6-b844-703873ae7bf8 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:24 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-e47e152e-ddff-47f6-b844-703873ae7bf8 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:24 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:38:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e47e152e-ddff-47f6-b844-703873ae7bf8 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e47e152e-ddff-47f6-b844-703873ae7bf8 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e47e152e-ddff-47f6-b844-703873ae7bf8 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e47e152e-ddff-47f6-b844-703873ae7bf8 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e47e152e-ddff-47f6-b844-703873ae7bf8 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e47e152e-ddff-47f6-b844-703873ae7bf8 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:24 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-e47e152e-ddff-47f6-b844-703873ae7bf8 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724cf4de81c4147929f43fd8744e8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6cebaed9654692bd9aef950a08741b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:38:24 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-e47e152e-ddff-47f6-b844-703873ae7bf8 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] 10.0.0.210 "GET /compute/v2.1/servers/daa798af-8437-4083-b73c-92b0cb39d861" status: 200 len: 1453 microversion: 2.1 time: 0.179142 Apr 12 00:38:24 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 163/491] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:38:24 2023] GET /compute/v2.1/servers/daa798af-8437-4083-b73c-92b0cb39d861 => generated 1453 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:25 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-ca6fd7c6-c55f-46ba-96cf-9dbcd50522cb req-159ab62c-f2a0-4940-927e-0176a0f06213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c8e8b7-1f91-4cf5-a222-c787a186444d", "name": "network-vif-plugged", "status": "completed", "tag": "a2a25522-be49-4ac7-9893-d030dc2d87ab"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:25 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:38:25 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-abfe0575-986e-45b6-8b56-21ed2356e6c4 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:25 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-abfe0575-986e-45b6-8b56-21ed2356e6c4 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-ca6fd7c6-c55f-46ba-96cf-9dbcd50522cb req-159ab62c-f2a0-4940-927e-0176a0f06213 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-ca6fd7c6-c55f-46ba-96cf-9dbcd50522cb req-159ab62c-f2a0-4940-927e-0176a0f06213 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-ca6fd7c6-c55f-46ba-96cf-9dbcd50522cb req-159ab62c-f2a0-4940-927e-0176a0f06213 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-abfe0575-986e-45b6-8b56-21ed2356e6c4 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-abfe0575-986e-45b6-8b56-21ed2356e6c4 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-abfe0575-986e-45b6-8b56-21ed2356e6c4 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-abfe0575-986e-45b6-8b56-21ed2356e6c4 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-abfe0575-986e-45b6-8b56-21ed2356e6c4 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-abfe0575-986e-45b6-8b56-21ed2356e6c4 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:25 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-ca6fd7c6-c55f-46ba-96cf-9dbcd50522cb req-159ab62c-f2a0-4940-927e-0176a0f06213 service nova] Creating event network-vif-plugged:a2a25522-be49-4ac7-9893-d030dc2d87ab for instance 49c8e8b7-1f91-4cf5-a222-c787a186444d on user Apr 12 00:38:25 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-ca6fd7c6-c55f-46ba-96cf-9dbcd50522cb req-159ab62c-f2a0-4940-927e-0176a0f06213 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033600 Apr 12 00:38:25 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 162/492] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:38:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:25 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-abfe0575-986e-45b6-8b56-21ed2356e6c4 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] HTTP exception thrown: Instance 570abef1-f803-4f3e-8051-b6f690063496 could not be found. Apr 12 00:38:25 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-abfe0575-986e-45b6-8b56-21ed2356e6c4 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Request method failure captured: Apr 12 00:38:25 user devstack@n-api.service[72496]: request: DELETE /compute/v2.1/servers/570abef1-f803-4f3e-8051-b6f690063496 HTTP/1.1 Apr 12 00:38:25 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:38:25 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:38:25 user devstack@n-api.service[72496]: Connection: close Apr 12 00:38:25 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:38:25 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:38:25 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:38:25 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:38:25 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:38:25 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNft1qKkmjD8Nll-qUgF19N1LJeB8PdcRbdn5Uq6buO7cPBS5Ov8OoI4tZ5vt-jvCknrLUCUXFnwniWtwxerLQ3Ye5xXh85fQ6mUUIOhguVUuxf5ZIys8tRE0XamxX86aNJtrX6fu_BHxUNtwTPq_PEt8q2KNpjT1y3XmuQXDJ2yaqus Apr 12 00:38:25 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:38:25 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:38:25 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:38:25 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:38:25 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:38:25 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:38:25 user devstack@n-api.service[72496]: X-Project-Id: 6ee31cdc6f4e4c2b9a8ec1e1c5076010 Apr 12 00:38:25 user devstack@n-api.service[72496]: X-Project-Name: tempest-ServersNegativeTestJSON-103053763 Apr 12 00:38:25 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:38:25 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:38:25 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ee31cdc6f4e4c2b9a8ec1e1c5076010"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6ee31cdc6f4e4c2b9a8ec1e1c5076010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ee31cdc6f4e4c2b9a8ec1e1c5076010"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:38:25 user devstack@n-api.service[72496]: X-Tenant: tempest-ServersNegativeTestJSON-103053763 Apr 12 00:38:25 user devstack@n-api.service[72496]: X-Tenant-Id: 6ee31cdc6f4e4c2b9a8ec1e1c5076010 Apr 12 00:38:25 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-ServersNegativeTestJSON-103053763 Apr 12 00:38:25 user devstack@n-api.service[72496]: X-User: tempest-ServersNegativeTestJSON-103053763-project-member Apr 12 00:38:25 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:38:25 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:38:25 user devstack@n-api.service[72496]: X-User-Id: 920d6d79e38e45fcb5153e712605764f Apr 12 00:38:25 user devstack@n-api.service[72496]: X-User-Name: tempest-ServersNegativeTestJSON-103053763-project-member Apr 12 00:38:25 user devstack@n-api.service[72496]: method: > Apr 12 00:38:25 user devstack@n-api.service[72496]: exception: Instance 570abef1-f803-4f3e-8051-b6f690063496 could not be found. Apr 12 00:38:25 user devstack@n-api.service[72496]: action_args: {'id': '570abef1-f803-4f3e-8051-b6f690063496'} Apr 12 00:38:25 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 570abef1-f803-4f3e-8051-b6f690063496 could not be found. Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 570abef1-f803-4f3e-8051-b6f690063496 could not be found. Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 570abef1-f803-4f3e-8051-b6f690063496 could not be found. Apr 12 00:38:25 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:38:25 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-abfe0575-986e-45b6-8b56-21ed2356e6c4 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Returning 404 to user: Instance 570abef1-f803-4f3e-8051-b6f690063496 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:38:25 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-abfe0575-986e-45b6-8b56-21ed2356e6c4 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/570abef1-f803-4f3e-8051-b6f690063496" status: 404 len: 111 microversion: 2.1 time: 0.044047 Apr 12 00:38:25 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 168/493] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:38:25 2023] DELETE /compute/v2.1/servers/570abef1-f803-4f3e-8051-b6f690063496 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 00:38:25 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-fb755a6e-ace4-4a69-925d-aa22b4ce18af tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:25 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-fb755a6e-ace4-4a69-925d-aa22b4ce18af tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: 570abef1-f803-4f3e-8051-b6f690063496] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fb755a6e-ace4-4a69-925d-aa22b4ce18af tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fb755a6e-ace4-4a69-925d-aa22b4ce18af tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fb755a6e-ace4-4a69-925d-aa22b4ce18af tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fb755a6e-ace4-4a69-925d-aa22b4ce18af tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fb755a6e-ace4-4a69-925d-aa22b4ce18af tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fb755a6e-ace4-4a69-925d-aa22b4ce18af tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:25 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-fb755a6e-ace4-4a69-925d-aa22b4ce18af tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] HTTP exception thrown: Instance 570abef1-f803-4f3e-8051-b6f690063496 could not be found. Apr 12 00:38:25 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-fb755a6e-ace4-4a69-925d-aa22b4ce18af tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Request method failure captured: Apr 12 00:38:25 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/570abef1-f803-4f3e-8051-b6f690063496 HTTP/1.1 Apr 12 00:38:25 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:38:25 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:38:25 user devstack@n-api.service[72494]: Connection: close Apr 12 00:38:25 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:38:25 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:38:25 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:38:25 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:38:25 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNft1qKkmjD8Nll-qUgF19N1LJeB8PdcRbdn5Uq6buO7cPBS5Ov8OoI4tZ5vt-jvCknrLUCUXFnwniWtwxerLQ3Ye5xXh85fQ6mUUIOhguVUuxf5ZIys8tRE0XamxX86aNJtrX6fu_BHxUNtwTPq_PEt8q2KNpjT1y3XmuQXDJ2yaqus Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Project-Id: 6ee31cdc6f4e4c2b9a8ec1e1c5076010 Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Project-Name: tempest-ServersNegativeTestJSON-103053763 Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ee31cdc6f4e4c2b9a8ec1e1c5076010"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6ee31cdc6f4e4c2b9a8ec1e1c5076010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ee31cdc6f4e4c2b9a8ec1e1c5076010"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Tenant: tempest-ServersNegativeTestJSON-103053763 Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Tenant-Id: 6ee31cdc6f4e4c2b9a8ec1e1c5076010 Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-ServersNegativeTestJSON-103053763 Apr 12 00:38:25 user devstack@n-api.service[72494]: X-User: tempest-ServersNegativeTestJSON-103053763-project-member Apr 12 00:38:25 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:38:25 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:38:25 user devstack@n-api.service[72494]: X-User-Id: 920d6d79e38e45fcb5153e712605764f Apr 12 00:38:25 user devstack@n-api.service[72494]: X-User-Name: tempest-ServersNegativeTestJSON-103053763-project-member Apr 12 00:38:25 user devstack@n-api.service[72494]: method: > Apr 12 00:38:25 user devstack@n-api.service[72494]: exception: Instance 570abef1-f803-4f3e-8051-b6f690063496 could not be found. Apr 12 00:38:25 user devstack@n-api.service[72494]: action_args: {'id': '570abef1-f803-4f3e-8051-b6f690063496'} Apr 12 00:38:25 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 570abef1-f803-4f3e-8051-b6f690063496 could not be found. Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 570abef1-f803-4f3e-8051-b6f690063496 could not be found. Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 570abef1-f803-4f3e-8051-b6f690063496 could not be found. Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:38:25 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-fb755a6e-ace4-4a69-925d-aa22b4ce18af tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Returning 404 to user: Instance 570abef1-f803-4f3e-8051-b6f690063496 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:38:25 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-fb755a6e-ace4-4a69-925d-aa22b4ce18af tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] 10.0.0.210 "GET /compute/v2.1/servers/570abef1-f803-4f3e-8051-b6f690063496" status: 404 len: 111 microversion: 2.1 time: 0.027237 Apr 12 00:38:25 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 164/494] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:38:25 2023] GET /compute/v2.1/servers/570abef1-f803-4f3e-8051-b6f690063496 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:38:25 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:25 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:25 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Going to try to terminate instance {{(pid=72495) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:38:25 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-979f1af5-497c-48ac-97cd-521f80145d01 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" status: 204 len: 0 microversion: 2.1 time: 0.125932 Apr 12 00:38:25 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 163/495] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:38:25 2023] DELETE /compute/v2.1/servers/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:38:25 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-a289ece7-4af3-4567-a9c9-2e9d42733800 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:25 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-a289ece7-4af3-4567-a9c9-2e9d42733800 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a289ece7-4af3-4567-a9c9-2e9d42733800 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a289ece7-4af3-4567-a9c9-2e9d42733800 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a289ece7-4af3-4567-a9c9-2e9d42733800 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a289ece7-4af3-4567-a9c9-2e9d42733800 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a289ece7-4af3-4567-a9c9-2e9d42733800 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a289ece7-4af3-4567-a9c9-2e9d42733800 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:25 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-9f637379-4b72-4ab2-aa9f-6ea157598207 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:25 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-9f637379-4b72-4ab2-aa9f-6ea157598207 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9f637379-4b72-4ab2-aa9f-6ea157598207 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9f637379-4b72-4ab2-aa9f-6ea157598207 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9f637379-4b72-4ab2-aa9f-6ea157598207 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9f637379-4b72-4ab2-aa9f-6ea157598207 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9f637379-4b72-4ab2-aa9f-6ea157598207 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9f637379-4b72-4ab2-aa9f-6ea157598207 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:25 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-9f637379-4b72-4ab2-aa9f-6ea157598207 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] HTTP exception thrown: Instance ba310127-67a9-4245-87f6-555e35f30a16 could not be found. Apr 12 00:38:25 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-9f637379-4b72-4ab2-aa9f-6ea157598207 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Request method failure captured: Apr 12 00:38:25 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/ba310127-67a9-4245-87f6-555e35f30a16 HTTP/1.1 Apr 12 00:38:25 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:38:25 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:38:25 user devstack@n-api.service[72494]: Connection: close Apr 12 00:38:25 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:38:25 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:38:25 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:38:25 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:38:25 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNfut1jPVwgpnHF2p4IDb8mw8QCnmrhPi1bglXERi9o-oc8KfA86Nj8qbMXqGPJ-Qu-hg1buox-hKkUkiuJLGP2TjR-hKqepkY3sMZyNoxK3mS9Lgsu4E_4fnuzEqTUjrpCZSmbPFt9R2omKh-uhIkWfp0X1fr8C_wHlflXHVBJsAvYQ Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Project-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Project-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Tenant: tempest-TestVolumeBootPattern-726466832 Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Tenant-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:38:25 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:38:25 user devstack@n-api.service[72494]: X-User: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:38:25 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:38:25 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:38:25 user devstack@n-api.service[72494]: X-User-Id: c479f6ae2f0d40908be9b07717ca3509 Apr 12 00:38:25 user devstack@n-api.service[72494]: X-User-Name: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:38:25 user devstack@n-api.service[72494]: method: > Apr 12 00:38:25 user devstack@n-api.service[72494]: exception: Instance ba310127-67a9-4245-87f6-555e35f30a16 could not be found. Apr 12 00:38:25 user devstack@n-api.service[72494]: action_args: {'id': 'ba310127-67a9-4245-87f6-555e35f30a16'} Apr 12 00:38:25 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba310127-67a9-4245-87f6-555e35f30a16 could not be found. Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba310127-67a9-4245-87f6-555e35f30a16 could not be found. Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba310127-67a9-4245-87f6-555e35f30a16 could not be found. Apr 12 00:38:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:38:25 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-9f637379-4b72-4ab2-aa9f-6ea157598207 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Returning 404 to user: Instance ba310127-67a9-4245-87f6-555e35f30a16 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:38:25 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-9f637379-4b72-4ab2-aa9f-6ea157598207 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ba310127-67a9-4245-87f6-555e35f30a16" status: 404 len: 111 microversion: 2.1 time: 0.033281 Apr 12 00:38:25 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 165/496] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:38:25 2023] GET /compute/v2.1/servers/ba310127-67a9-4245-87f6-555e35f30a16 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:38:25 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-a289ece7-4af3-4567-a9c9-2e9d42733800 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920d6d79e38e45fcb5153e712605764f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee31cdc6f4e4c2b9a8ec1e1c5076010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:38:25 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-a289ece7-4af3-4567-a9c9-2e9d42733800 tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" status: 200 len: 1499 microversion: 2.1 time: 0.180514 Apr 12 00:38:25 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 169/497] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:38:25 2023] GET /compute/v2.1/servers/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 => generated 1499 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:26 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-41691ed7-dc5a-4b71-9139-daa8617f07b2 req-d7151423-db35-45bf-9337-5fdb8f6fe5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9", "name": "network-vif-unplugged", "status": "completed", "tag": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-41691ed7-dc5a-4b71-9139-daa8617f07b2 req-d7151423-db35-45bf-9337-5fdb8f6fe5d0 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-41691ed7-dc5a-4b71-9139-daa8617f07b2 req-d7151423-db35-45bf-9337-5fdb8f6fe5d0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-41691ed7-dc5a-4b71-9139-daa8617f07b2 req-d7151423-db35-45bf-9337-5fdb8f6fe5d0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:26 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-41691ed7-dc5a-4b71-9139-daa8617f07b2 req-d7151423-db35-45bf-9337-5fdb8f6fe5d0 service nova] Creating event network-vif-unplugged:cc385c2b-9f16-4daf-a929-f3c9e133e5fa for instance ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 on user Apr 12 00:38:26 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-41691ed7-dc5a-4b71-9139-daa8617f07b2 req-d7151423-db35-45bf-9337-5fdb8f6fe5d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029343 Apr 12 00:38:26 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 164/498] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:38:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:27 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:27 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Going to try to terminate instance {{(pid=72494) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:38:27 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-1eb38071-ae83-4f86-a60a-9f4fbd4eb67c tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d8833bad-d30f-4cd4-aa66-10d60c782061" status: 204 len: 0 microversion: 2.1 time: 0.288747 Apr 12 00:38:27 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 166/499] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:38:27 2023] DELETE /compute/v2.1/servers/d8833bad-d30f-4cd4-aa66-10d60c782061 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:38:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-b3ccf79a-6ee2-48e7-8f7e-3bf03ac088d7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:27 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-b3ccf79a-6ee2-48e7-8f7e-3bf03ac088d7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b3ccf79a-6ee2-48e7-8f7e-3bf03ac088d7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b3ccf79a-6ee2-48e7-8f7e-3bf03ac088d7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b3ccf79a-6ee2-48e7-8f7e-3bf03ac088d7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b3ccf79a-6ee2-48e7-8f7e-3bf03ac088d7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b3ccf79a-6ee2-48e7-8f7e-3bf03ac088d7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b3ccf79a-6ee2-48e7-8f7e-3bf03ac088d7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:27 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-b3ccf79a-6ee2-48e7-8f7e-3bf03ac088d7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:38:27 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-b3ccf79a-6ee2-48e7-8f7e-3bf03ac088d7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8833bad-d30f-4cd4-aa66-10d60c782061" status: 200 len: 1397 microversion: 2.1 time: 0.271368 Apr 12 00:38:27 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 170/500] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:38:27 2023] GET /compute/v2.1/servers/d8833bad-d30f-4cd4-aa66-10d60c782061 => generated 1397 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:27 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:38:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-d39e9261-d3d2-4612-9744-3d3d06849bfa req-8ede2294-11cd-4fb3-9a59-0ce7292b66e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8833bad-d30f-4cd4-aa66-10d60c782061", "name": "network-vif-unplugged", "status": "completed", "tag": "5512329a-21f4-4114-b881-ede435da55c8"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d39e9261-d3d2-4612-9744-3d3d06849bfa req-8ede2294-11cd-4fb3-9a59-0ce7292b66e8 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d39e9261-d3d2-4612-9744-3d3d06849bfa req-8ede2294-11cd-4fb3-9a59-0ce7292b66e8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d39e9261-d3d2-4612-9744-3d3d06849bfa req-8ede2294-11cd-4fb3-9a59-0ce7292b66e8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:27 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-d39e9261-d3d2-4612-9744-3d3d06849bfa req-8ede2294-11cd-4fb3-9a59-0ce7292b66e8 service nova] Creating event network-vif-unplugged:5512329a-21f4-4114-b881-ede435da55c8 for instance d8833bad-d30f-4cd4-aa66-10d60c782061 on user Apr 12 00:38:27 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-d39e9261-d3d2-4612-9744-3d3d06849bfa req-8ede2294-11cd-4fb3-9a59-0ce7292b66e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043553 Apr 12 00:38:27 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 165/501] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:38:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:28 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-96fc8dab-5713-4f73-a52e-8766f4521c4b req-168eb87e-4fc8-4923-a4c6-f98818956280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9", "name": "network-vif-plugged", "status": "completed", "tag": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa"}, {"server_uuid": "ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9", "name": "network-vif-deleted", "tag": "cc385c2b-9f16-4daf-a929-f3c9e133e5fa"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:28 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-96fc8dab-5713-4f73-a52e-8766f4521c4b req-168eb87e-4fc8-4923-a4c6-f98818956280 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:28 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-96fc8dab-5713-4f73-a52e-8766f4521c4b req-168eb87e-4fc8-4923-a4c6-f98818956280 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:28 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-96fc8dab-5713-4f73-a52e-8766f4521c4b req-168eb87e-4fc8-4923-a4c6-f98818956280 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:28 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-96fc8dab-5713-4f73-a52e-8766f4521c4b req-168eb87e-4fc8-4923-a4c6-f98818956280 service nova] Creating event network-vif-plugged:cc385c2b-9f16-4daf-a929-f3c9e133e5fa for instance ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 on user Apr 12 00:38:28 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-96fc8dab-5713-4f73-a52e-8766f4521c4b req-168eb87e-4fc8-4923-a4c6-f98818956280 service nova] Creating event network-vif-deleted:cc385c2b-9f16-4daf-a929-f3c9e133e5fa for instance ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 on user Apr 12 00:38:28 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-96fc8dab-5713-4f73-a52e-8766f4521c4b req-168eb87e-4fc8-4923-a4c6-f98818956280 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039899 Apr 12 00:38:28 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 167/502] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:38:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:28 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-76355d28-12d7-4a5c-b95f-823822b9f648 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:28 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-76355d28-12d7-4a5c-b95f-823822b9f648 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] [instance: 9d67708d-1bcf-4d32-8d45-22376ec72e34] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:28 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-76355d28-12d7-4a5c-b95f-823822b9f648 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:28 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-76355d28-12d7-4a5c-b95f-823822b9f648 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:28 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-76355d28-12d7-4a5c-b95f-823822b9f648 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:28 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-76355d28-12d7-4a5c-b95f-823822b9f648 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:28 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-76355d28-12d7-4a5c-b95f-823822b9f648 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:28 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-76355d28-12d7-4a5c-b95f-823822b9f648 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:28 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-76355d28-12d7-4a5c-b95f-823822b9f648 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] HTTP exception thrown: Instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 could not be found. Apr 12 00:38:28 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-76355d28-12d7-4a5c-b95f-823822b9f648 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Request method failure captured: Apr 12 00:38:28 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34 HTTP/1.1 Apr 12 00:38:28 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:38:28 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:38:28 user devstack@n-api.service[72496]: Connection: close Apr 12 00:38:28 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:38:28 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:38:28 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:38:28 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:38:28 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:38:28 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNfvHhjrcsxN9_1PrP73jXUVEidpIyekZAmk9BoPI0aMctReosILXiu_5wotM-_5nviDsG5dVNFA8GYB0Vl4vzLlw889_8V5LBQRlNi3E1hvnndVhqYKbDfpnyqxjJL-WfvywZkQ_HIHca68N4LR3IWw-67E5d9z8EOufFCJKPct2AQA Apr 12 00:38:28 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:38:28 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:38:28 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:38:28 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:38:28 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:38:28 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:38:28 user devstack@n-api.service[72496]: X-Project-Id: e12eca8b17b844a8821294ec9dd19de8 Apr 12 00:38:28 user devstack@n-api.service[72496]: X-Project-Name: tempest-SnapshotDataIntegrityTests-282769033 Apr 12 00:38:28 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:38:28 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:38:28 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e12eca8b17b844a8821294ec9dd19de8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e12eca8b17b844a8821294ec9dd19de8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e12eca8b17b844a8821294ec9dd19de8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:38:28 user devstack@n-api.service[72496]: X-Tenant: tempest-SnapshotDataIntegrityTests-282769033 Apr 12 00:38:28 user devstack@n-api.service[72496]: X-Tenant-Id: e12eca8b17b844a8821294ec9dd19de8 Apr 12 00:38:28 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-282769033 Apr 12 00:38:28 user devstack@n-api.service[72496]: X-User: tempest-SnapshotDataIntegrityTests-282769033-project-member Apr 12 00:38:28 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:38:28 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:38:28 user devstack@n-api.service[72496]: X-User-Id: c5219586e4e24c33a8cdf52c21d875bd Apr 12 00:38:28 user devstack@n-api.service[72496]: X-User-Name: tempest-SnapshotDataIntegrityTests-282769033-project-member Apr 12 00:38:28 user devstack@n-api.service[72496]: method: > Apr 12 00:38:28 user devstack@n-api.service[72496]: exception: Instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 could not be found. Apr 12 00:38:28 user devstack@n-api.service[72496]: action_args: {'id': '9d67708d-1bcf-4d32-8d45-22376ec72e34'} Apr 12 00:38:28 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 could not be found. Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 could not be found. Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 could not be found. Apr 12 00:38:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:38:28 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-76355d28-12d7-4a5c-b95f-823822b9f648 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Returning 404 to user: Instance 9d67708d-1bcf-4d32-8d45-22376ec72e34 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:38:28 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-76355d28-12d7-4a5c-b95f-823822b9f648 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34" status: 404 len: 111 microversion: 2.1 time: 0.033437 Apr 12 00:38:28 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 171/503] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:38:28 2023] GET /compute/v2.1/servers/9d67708d-1bcf-4d32-8d45-22376ec72e34 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:38:28 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-17ca4995-7de0-43d5-b03b-f0655c6ad5d3 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] Calling method '.version_select at 0x7f7cd47d05e0>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:28 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-17ca4995-7de0-43d5-b03b-f0655c6ad5d3 tempest-SnapshotDataIntegrityTests-282769033 tempest-SnapshotDataIntegrityTests-282769033-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1604911239" status: 202 len: 0 microversion: 2.1 time: 0.021950 Apr 12 00:38:28 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 166/504] 10.0.0.210 () {62 vars in 1355 bytes} [Wed Apr 12 00:38:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1604911239 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:38:29 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:38:29 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "6e4c1e91-eee3-4f24-9777-322df51a65d9"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:29 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:29 user devstack@n-api.service[72494]: DEBUG nova.objects.instance [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'flavor' on Instance uuid 1277a40a-6389-4d88-bbc6-bda27d465c35 {{(pid=72494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:38:29 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-4627393f-29c1-462a-aeed-e4800b512310 req-49b169c4-e170-46a7-88f7-f994f9f7a569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8833bad-d30f-4cd4-aa66-10d60c782061", "name": "network-vif-plugged", "status": "completed", "tag": "5512329a-21f4-4114-b881-ede435da55c8"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:29 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:38:29 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:38:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4627393f-29c1-462a-aeed-e4800b512310 req-49b169c4-e170-46a7-88f7-f994f9f7a569 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4627393f-29c1-462a-aeed-e4800b512310 req-49b169c4-e170-46a7-88f7-f994f9f7a569 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4627393f-29c1-462a-aeed-e4800b512310 req-49b169c4-e170-46a7-88f7-f994f9f7a569 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:29 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-4627393f-29c1-462a-aeed-e4800b512310 req-49b169c4-e170-46a7-88f7-f994f9f7a569 service nova] Creating event network-vif-plugged:5512329a-21f4-4114-b881-ede435da55c8 for instance d8833bad-d30f-4cd4-aa66-10d60c782061 on user Apr 12 00:38:29 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-4627393f-29c1-462a-aeed-e4800b512310 req-49b169c4-e170-46a7-88f7-f994f9f7a569 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041173 Apr 12 00:38:29 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 172/505] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:38:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:30 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-bdbc7c26-0e9c-4fcf-838b-d459753cfe21 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1277a40a-6389-4d88-bbc6-bda27d465c35/action" status: 200 len: 29 microversion: 2.87 time: 0.588964 Apr 12 00:38:30 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 168/506] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 00:38:29 2023] POST /compute/v2.1/servers/1277a40a-6389-4d88-bbc6-bda27d465c35/action => generated 29 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:30 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-4a49c7cf-fe04-4c99-93cb-a8413c120591 req-67b4e487-0b53-42c9-9b95-aed7f0b97c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8833bad-d30f-4cd4-aa66-10d60c782061", "name": "network-vif-deleted", "tag": "5512329a-21f4-4114-b881-ede435da55c8"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:30 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-f7c3efc8-ed65-4e1e-98bc-a1444f57d146 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:30 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-f7c3efc8-ed65-4e1e-98bc-a1444f57d146 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:30 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-4a49c7cf-fe04-4c99-93cb-a8413c120591 req-67b4e487-0b53-42c9-9b95-aed7f0b97c38 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:30 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-4a49c7cf-fe04-4c99-93cb-a8413c120591 req-67b4e487-0b53-42c9-9b95-aed7f0b97c38 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:30 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f7c3efc8-ed65-4e1e-98bc-a1444f57d146 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:30 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-4a49c7cf-fe04-4c99-93cb-a8413c120591 req-67b4e487-0b53-42c9-9b95-aed7f0b97c38 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:30 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f7c3efc8-ed65-4e1e-98bc-a1444f57d146 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:30 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f7c3efc8-ed65-4e1e-98bc-a1444f57d146 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:30 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f7c3efc8-ed65-4e1e-98bc-a1444f57d146 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:30 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f7c3efc8-ed65-4e1e-98bc-a1444f57d146 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:30 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f7c3efc8-ed65-4e1e-98bc-a1444f57d146 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:30 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-4a49c7cf-fe04-4c99-93cb-a8413c120591 req-67b4e487-0b53-42c9-9b95-aed7f0b97c38 service nova] Creating event network-vif-deleted:5512329a-21f4-4114-b881-ede435da55c8 for instance d8833bad-d30f-4cd4-aa66-10d60c782061 on user Apr 12 00:38:30 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-4a49c7cf-fe04-4c99-93cb-a8413c120591 req-67b4e487-0b53-42c9-9b95-aed7f0b97c38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037088 Apr 12 00:38:30 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 167/507] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:38:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:30 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-f7c3efc8-ed65-4e1e-98bc-a1444f57d146 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:38:30 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-f7c3efc8-ed65-4e1e-98bc-a1444f57d146 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:38:30 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-f7c3efc8-ed65-4e1e-98bc-a1444f57d146 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:38:30 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-f7c3efc8-ed65-4e1e-98bc-a1444f57d146 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1277a40a-6389-4d88-bbc6-bda27d465c35" status: 200 len: 1774 microversion: 2.87 time: 0.302978 Apr 12 00:38:30 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 173/508] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:38:30 2023] GET /compute/v2.1/servers/1277a40a-6389-4d88-bbc6-bda27d465c35 => generated 1774 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:38:31 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-475c91c2-5ebc-43ec-b29c-95ff431303b0 req-c8c2c87a-6459-486c-80c9-f48def2ad6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1277a40a-6389-4d88-bbc6-bda27d465c35", "name": "network-vif-unplugged", "status": "completed", "tag": "8e32719d-1d2e-439a-9dba-9ac82140fbac"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:31 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-475c91c2-5ebc-43ec-b29c-95ff431303b0 req-c8c2c87a-6459-486c-80c9-f48def2ad6e5 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:31 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-475c91c2-5ebc-43ec-b29c-95ff431303b0 req-c8c2c87a-6459-486c-80c9-f48def2ad6e5 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:31 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-475c91c2-5ebc-43ec-b29c-95ff431303b0 req-c8c2c87a-6459-486c-80c9-f48def2ad6e5 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:31 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-475c91c2-5ebc-43ec-b29c-95ff431303b0 req-c8c2c87a-6459-486c-80c9-f48def2ad6e5 service nova] Creating event network-vif-unplugged:8e32719d-1d2e-439a-9dba-9ac82140fbac for instance 1277a40a-6389-4d88-bbc6-bda27d465c35 on user Apr 12 00:38:31 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-475c91c2-5ebc-43ec-b29c-95ff431303b0 req-c8c2c87a-6459-486c-80c9-f48def2ad6e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038529 Apr 12 00:38:31 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 169/509] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:38:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:33 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-7c14ae8e-cede-4dfe-811a-d47043238872 req-77a7527b-ad35-4ca3-9cb9-e5c01d514338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1277a40a-6389-4d88-bbc6-bda27d465c35", "name": "network-vif-plugged", "status": "completed", "tag": "8e32719d-1d2e-439a-9dba-9ac82140fbac"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-7c14ae8e-cede-4dfe-811a-d47043238872 req-77a7527b-ad35-4ca3-9cb9-e5c01d514338 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-7c14ae8e-cede-4dfe-811a-d47043238872 req-77a7527b-ad35-4ca3-9cb9-e5c01d514338 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-7c14ae8e-cede-4dfe-811a-d47043238872 req-77a7527b-ad35-4ca3-9cb9-e5c01d514338 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:33 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-7c14ae8e-cede-4dfe-811a-d47043238872 req-77a7527b-ad35-4ca3-9cb9-e5c01d514338 service nova] Creating event network-vif-plugged:8e32719d-1d2e-439a-9dba-9ac82140fbac for instance 1277a40a-6389-4d88-bbc6-bda27d465c35 on user Apr 12 00:38:33 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-7c14ae8e-cede-4dfe-811a-d47043238872 req-77a7527b-ad35-4ca3-9cb9-e5c01d514338 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032597 Apr 12 00:38:33 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 168/510] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:38:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:35 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-f30f1938-e0b6-4fcc-a1c4-14e91494e24a req-f829b4a7-24cc-4234-ad9c-c2ac137563a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1277a40a-6389-4d88-bbc6-bda27d465c35", "name": "network-vif-plugged", "status": "completed", "tag": "8e32719d-1d2e-439a-9dba-9ac82140fbac"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-f30f1938-e0b6-4fcc-a1c4-14e91494e24a req-f829b4a7-24cc-4234-ad9c-c2ac137563a0 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-f30f1938-e0b6-4fcc-a1c4-14e91494e24a req-f829b4a7-24cc-4234-ad9c-c2ac137563a0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-f30f1938-e0b6-4fcc-a1c4-14e91494e24a req-f829b4a7-24cc-4234-ad9c-c2ac137563a0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:35 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-f30f1938-e0b6-4fcc-a1c4-14e91494e24a req-f829b4a7-24cc-4234-ad9c-c2ac137563a0 service nova] Creating event network-vif-plugged:8e32719d-1d2e-439a-9dba-9ac82140fbac for instance 1277a40a-6389-4d88-bbc6-bda27d465c35 on user Apr 12 00:38:35 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-f30f1938-e0b6-4fcc-a1c4-14e91494e24a req-f829b4a7-24cc-4234-ad9c-c2ac137563a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043360 Apr 12 00:38:35 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 174/511] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:38:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:37 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-8c9f8247-e1c1-423e-b626-1696c92e6f30 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:37 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-8c9f8247-e1c1-423e-b626-1696c92e6f30 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8c9f8247-e1c1-423e-b626-1696c92e6f30 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8c9f8247-e1c1-423e-b626-1696c92e6f30 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8c9f8247-e1c1-423e-b626-1696c92e6f30 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8c9f8247-e1c1-423e-b626-1696c92e6f30 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8c9f8247-e1c1-423e-b626-1696c92e6f30 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8c9f8247-e1c1-423e-b626-1696c92e6f30 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:37 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-8c9f8247-e1c1-423e-b626-1696c92e6f30 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:38:37 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-8c9f8247-e1c1-423e-b626-1696c92e6f30 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 200 len: 1676 microversion: 2.1 time: 0.150444 Apr 12 00:38:37 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 170/512] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:38:37 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:37 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09c62c76-e1a1-483c-a846-9f5be2dcec9b"}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:37 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:37 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:37 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:37 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:37 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:37 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:37 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:37 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-49f50dac-2547-40ee-bb8a-f1567c4b1f1c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259618 Apr 12 00:38:37 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 169/513] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 00:38:37 2023] POST /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:37 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-e33eeaf8-5439-40b5-a664-3e0c95997fd1 req-d55b293b-b6cf-470f-8f7d-1c04c342fb13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1277a40a-6389-4d88-bbc6-bda27d465c35", "name": "network-vif-plugged", "status": "completed", "tag": "8e32719d-1d2e-439a-9dba-9ac82140fbac"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-e33eeaf8-5439-40b5-a664-3e0c95997fd1 req-d55b293b-b6cf-470f-8f7d-1c04c342fb13 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-e33eeaf8-5439-40b5-a664-3e0c95997fd1 req-d55b293b-b6cf-470f-8f7d-1c04c342fb13 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-e33eeaf8-5439-40b5-a664-3e0c95997fd1 req-d55b293b-b6cf-470f-8f7d-1c04c342fb13 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:37 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-e33eeaf8-5439-40b5-a664-3e0c95997fd1 req-d55b293b-b6cf-470f-8f7d-1c04c342fb13 service nova] Creating event network-vif-plugged:8e32719d-1d2e-439a-9dba-9ac82140fbac for instance 1277a40a-6389-4d88-bbc6-bda27d465c35 on user Apr 12 00:38:37 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-e33eeaf8-5439-40b5-a664-3e0c95997fd1 req-d55b293b-b6cf-470f-8f7d-1c04c342fb13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041520 Apr 12 00:38:37 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 175/514] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:38:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:42 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-a6bffca2-2946-4085-8117-959ba1888fdc tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:42 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-a6bffca2-2946-4085-8117-959ba1888fdc tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a6bffca2-2946-4085-8117-959ba1888fdc tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a6bffca2-2946-4085-8117-959ba1888fdc tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a6bffca2-2946-4085-8117-959ba1888fdc tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a6bffca2-2946-4085-8117-959ba1888fdc tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a6bffca2-2946-4085-8117-959ba1888fdc tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a6bffca2-2946-4085-8117-959ba1888fdc tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:42 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-a6bffca2-2946-4085-8117-959ba1888fdc tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c276268b63084515a43caa837af30fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c1003f0d1847b7b4c679b0f7cc3110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:38:42 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-a6bffca2-2946-4085-8117-959ba1888fdc tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2164441-0fa4-463c-afde-a333095d0e56" status: 200 len: 1494 microversion: 2.1 time: 0.161522 Apr 12 00:38:42 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 171/515] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:38:42 2023] GET /compute/v2.1/servers/f2164441-0fa4-463c-afde-a333095d0e56 => generated 1494 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:38:45 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:45 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:45 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:38:45 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Old instance type m1.nano, new instance type m1.micro {{(pid=72495) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 12 00:38:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:45 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting quotas for project d8ba626fdf264b879099a89097845153. Resources: {'ram', 'cores'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:38:45 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting quotas for user d658147b4def4d12a16381d4c19357e3 and project d8ba626fdf264b879099a89097845153. Resources: {'ram', 'cores'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:38:45 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:38:45 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:38:45 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:38:45 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:38:45 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:38:45 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-1be15261-18ca-409a-b222-b6dcd089bebb tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/action" status: 202 len: 0 microversion: 2.1 time: 0.331210 Apr 12 00:38:45 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 170/516] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 00:38:45 2023] POST /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:38:45 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-13f215b5-ab56-4873-a1b9-64e5dd54d4a8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:45 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-13f215b5-ab56-4873-a1b9-64e5dd54d4a8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:45 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-13f215b5-ab56-4873-a1b9-64e5dd54d4a8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:45 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-13f215b5-ab56-4873-a1b9-64e5dd54d4a8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:45 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-13f215b5-ab56-4873-a1b9-64e5dd54d4a8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:45 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-13f215b5-ab56-4873-a1b9-64e5dd54d4a8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:45 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-13f215b5-ab56-4873-a1b9-64e5dd54d4a8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:45 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-13f215b5-ab56-4873-a1b9-64e5dd54d4a8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:45 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-13f215b5-ab56-4873-a1b9-64e5dd54d4a8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:38:45 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-13f215b5-ab56-4873-a1b9-64e5dd54d4a8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 200 len: 1731 microversion: 2.1 time: 0.153430 Apr 12 00:38:45 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 176/517] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:38:45 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:38:48 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-08330cca-623e-4647-9de8-e269531f1d45 req-7a07e2c4-f32f-419d-a524-b38c2fcc050a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe6d6bc-65a6-469a-89a0-7e4c51620b14", "name": "network-vif-unplugged", "status": "completed", "tag": "b99b54c2-0b21-42ea-91d0-087aa230da7e"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:48 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-08330cca-623e-4647-9de8-e269531f1d45 req-7a07e2c4-f32f-419d-a524-b38c2fcc050a service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:48 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-08330cca-623e-4647-9de8-e269531f1d45 req-7a07e2c4-f32f-419d-a524-b38c2fcc050a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:48 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-08330cca-623e-4647-9de8-e269531f1d45 req-7a07e2c4-f32f-419d-a524-b38c2fcc050a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:48 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-08330cca-623e-4647-9de8-e269531f1d45 req-7a07e2c4-f32f-419d-a524-b38c2fcc050a service nova] Creating event network-vif-unplugged:b99b54c2-0b21-42ea-91d0-087aa230da7e for instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 on user Apr 12 00:38:48 user devstack@n-api.service[72494]: DEBUG nova.compute.api [req-08330cca-623e-4647-9de8-e269531f1d45 req-7a07e2c4-f32f-419d-a524-b38c2fcc050a service nova] Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 00:38:48 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-08330cca-623e-4647-9de8-e269531f1d45 req-7a07e2c4-f32f-419d-a524-b38c2fcc050a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054832 Apr 12 00:38:48 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 172/518] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:38:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:50 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-d5d3797c-be81-42fc-8011-218bc72a1ae2 req-81244cb4-db50-4a8c-85ea-aee721fc78a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe6d6bc-65a6-469a-89a0-7e4c51620b14", "name": "network-vif-plugged", "status": "completed", "tag": "b99b54c2-0b21-42ea-91d0-087aa230da7e"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d5d3797c-be81-42fc-8011-218bc72a1ae2 req-81244cb4-db50-4a8c-85ea-aee721fc78a3 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d5d3797c-be81-42fc-8011-218bc72a1ae2 req-81244cb4-db50-4a8c-85ea-aee721fc78a3 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d5d3797c-be81-42fc-8011-218bc72a1ae2 req-81244cb4-db50-4a8c-85ea-aee721fc78a3 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:50 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-d5d3797c-be81-42fc-8011-218bc72a1ae2 req-81244cb4-db50-4a8c-85ea-aee721fc78a3 service nova] Creating event network-vif-plugged:b99b54c2-0b21-42ea-91d0-087aa230da7e for instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 on user Apr 12 00:38:50 user devstack@n-api.service[72495]: DEBUG nova.compute.api [req-d5d3797c-be81-42fc-8011-218bc72a1ae2 req-81244cb4-db50-4a8c-85ea-aee721fc78a3 service nova] Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72495) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 00:38:50 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-d5d3797c-be81-42fc-8011-218bc72a1ae2 req-81244cb4-db50-4a8c-85ea-aee721fc78a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059732 Apr 12 00:38:50 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 171/519] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:38:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:50 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-7a51682b-a80a-463d-bfe9-788da0bf9dc1 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:50 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-7a51682b-a80a-463d-bfe9-788da0bf9dc1 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] [instance: d25bc2e7-3399-47be-b78d-990acbb51749] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7a51682b-a80a-463d-bfe9-788da0bf9dc1 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7a51682b-a80a-463d-bfe9-788da0bf9dc1 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7a51682b-a80a-463d-bfe9-788da0bf9dc1 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7a51682b-a80a-463d-bfe9-788da0bf9dc1 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7a51682b-a80a-463d-bfe9-788da0bf9dc1 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7a51682b-a80a-463d-bfe9-788da0bf9dc1 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:50 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-7a51682b-a80a-463d-bfe9-788da0bf9dc1 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] HTTP exception thrown: Instance d25bc2e7-3399-47be-b78d-990acbb51749 could not be found. Apr 12 00:38:50 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-7a51682b-a80a-463d-bfe9-788da0bf9dc1 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Request method failure captured: Apr 12 00:38:50 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749 HTTP/1.1 Apr 12 00:38:50 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:38:50 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:38:50 user devstack@n-api.service[72496]: Connection: close Apr 12 00:38:50 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:38:50 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:38:50 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:38:50 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:38:50 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:38:50 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNfuzV55VWUE3JdVtifhFJCNnP1Bgsb7r2GxdEYXwNXLiUDtWA4ch6eL2vyvz9lSmVsG4O-6l7yqdwxbxyzMzx0e6JdWHktH5EVWtzkMLFO_UD8JNWkKI2Ag996GuHrBhyU17TxUiO7R9WsYOLl42Gfwej0nl6kqcdoNBd61GIivKtZQ Apr 12 00:38:50 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:38:50 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:38:50 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:38:50 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:38:50 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:38:50 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:38:50 user devstack@n-api.service[72496]: X-Project-Id: ca0ea21a2d4d400cba79444c68b58aed Apr 12 00:38:50 user devstack@n-api.service[72496]: X-Project-Name: tempest-TestStampPattern-628358733 Apr 12 00:38:50 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:38:50 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:38:50 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ca0ea21a2d4d400cba79444c68b58aed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ca0ea21a2d4d400cba79444c68b58aed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ca0ea21a2d4d400cba79444c68b58aed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:38:50 user devstack@n-api.service[72496]: X-Tenant: tempest-TestStampPattern-628358733 Apr 12 00:38:50 user devstack@n-api.service[72496]: X-Tenant-Id: ca0ea21a2d4d400cba79444c68b58aed Apr 12 00:38:50 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-TestStampPattern-628358733 Apr 12 00:38:50 user devstack@n-api.service[72496]: X-User: tempest-TestStampPattern-628358733-project-member Apr 12 00:38:50 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:38:50 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:38:50 user devstack@n-api.service[72496]: X-User-Id: 0e843a45549943cb88b1b3123a2fbe8a Apr 12 00:38:50 user devstack@n-api.service[72496]: X-User-Name: tempest-TestStampPattern-628358733-project-member Apr 12 00:38:50 user devstack@n-api.service[72496]: method: > Apr 12 00:38:50 user devstack@n-api.service[72496]: exception: Instance d25bc2e7-3399-47be-b78d-990acbb51749 could not be found. Apr 12 00:38:50 user devstack@n-api.service[72496]: action_args: {'id': 'd25bc2e7-3399-47be-b78d-990acbb51749'} Apr 12 00:38:50 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d25bc2e7-3399-47be-b78d-990acbb51749 could not be found. Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d25bc2e7-3399-47be-b78d-990acbb51749 could not be found. Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d25bc2e7-3399-47be-b78d-990acbb51749 could not be found. Apr 12 00:38:50 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:38:50 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-7a51682b-a80a-463d-bfe9-788da0bf9dc1 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Returning 404 to user: Instance d25bc2e7-3399-47be-b78d-990acbb51749 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:38:50 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-7a51682b-a80a-463d-bfe9-788da0bf9dc1 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749" status: 404 len: 111 microversion: 2.1 time: 0.029630 Apr 12 00:38:50 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 177/520] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:38:50 2023] GET /compute/v2.1/servers/d25bc2e7-3399-47be-b78d-990acbb51749 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:38:53 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-df7ce528-f679-4c71-a758-cea89e75dbb2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] Calling method '.version_select at 0x7f7cd461ac20>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:53 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-df7ce528-f679-4c71-a758-cea89e75dbb2 tempest-TestStampPattern-628358733 tempest-TestStampPattern-628358733-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1883128824" status: 202 len: 0 microversion: 2.1 time: 0.023165 Apr 12 00:38:53 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 173/521] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 00:38:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1883128824 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:38:58 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=3 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:38:58 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-794361f9-9ed3-41a0-9bb5-4f117f80604f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:58 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-794361f9-9ed3-41a0-9bb5-4f117f80604f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:58 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:38:58 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-794361f9-9ed3-41a0-9bb5-4f117f80604f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:58 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-794361f9-9ed3-41a0-9bb5-4f117f80604f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:58 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-794361f9-9ed3-41a0-9bb5-4f117f80604f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:58 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-794361f9-9ed3-41a0-9bb5-4f117f80604f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:58 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-794361f9-9ed3-41a0-9bb5-4f117f80604f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:58 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-794361f9-9ed3-41a0-9bb5-4f117f80604f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:58 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:38:58 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-794361f9-9ed3-41a0-9bb5-4f117f80604f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] HTTP exception thrown: Instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 could not be found. Apr 12 00:38:58 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-794361f9-9ed3-41a0-9bb5-4f117f80604f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Request method failure captured: Apr 12 00:38:58 user devstack@n-api.service[72495]: request: GET /compute/v2.1/servers/8fd7bb9c-9e20-49f2-8848-162a784b9885 HTTP/1.1 Apr 12 00:38:58 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:38:58 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:38:58 user devstack@n-api.service[72495]: Connection: close Apr 12 00:38:58 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 00:38:58 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:38:58 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:38:58 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:38:58 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:38:58 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNfx-yPB8Addd9whxbTRQOdN90sGir-xfc1IiR7-ECw56svld7JonHx7axp9WUmnT4KzR5TFzU-_uCRK58QPK_z1_aUm3UKF-xkJbrjTzJI02gd86EhzUOHFXsNSRIvLDd7tPEw_YsNig7FJnlwWFmOoZQqpImrudgWYdjbdfFy26et4 Apr 12 00:38:58 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:38:58 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:38:58 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:38:58 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:38:58 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:38:58 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:38:58 user devstack@n-api.service[72495]: X-Project-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:38:58 user devstack@n-api.service[72495]: X-Project-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:38:58 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:38:58 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:38:58 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b56f3c567dc84773a33d596920df727a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:38:58 user devstack@n-api.service[72495]: X-Tenant: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:38:58 user devstack@n-api.service[72495]: X-Tenant-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:38:58 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:38:58 user devstack@n-api.service[72495]: X-User: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:38:58 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:38:58 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:38:58 user devstack@n-api.service[72495]: X-User-Id: d373f582479c441e8ce9849ca694a186 Apr 12 00:38:58 user devstack@n-api.service[72495]: X-User-Name: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:38:58 user devstack@n-api.service[72495]: method: > Apr 12 00:38:58 user devstack@n-api.service[72495]: exception: Instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 could not be found. Apr 12 00:38:58 user devstack@n-api.service[72495]: action_args: {'id': '8fd7bb9c-9e20-49f2-8848-162a784b9885'} Apr 12 00:38:58 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 could not be found. Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 could not be found. Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 could not be found. Apr 12 00:38:58 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:38:58 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-794361f9-9ed3-41a0-9bb5-4f117f80604f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Returning 404 to user: Instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:38:58 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-794361f9-9ed3-41a0-9bb5-4f117f80604f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8fd7bb9c-9e20-49f2-8848-162a784b9885" status: 404 len: 111 microversion: 2.1 time: 0.047601 Apr 12 00:38:58 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 172/522] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:38:58 2023] GET /compute/v2.1/servers/8fd7bb9c-9e20-49f2-8848-162a784b9885 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:38:58 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-22b39c12-033f-4264-bde8-b52fb84bb42c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '.version_select at 0x7f7cd46700d0>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:58 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=24 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:38:58 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-22b39c12-033f-4264-bde8-b52fb84bb42c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-665321536" status: 202 len: 0 microversion: 2.1 time: 0.028296 Apr 12 00:38:58 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 178/523] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 00:38:58 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-665321536 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 00:38:59 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:38:59 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:59 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:59 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:38:59 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:59 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:59 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:59 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:59 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:59 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:59 user devstack@n-api.service[72494]: DEBUG nova.objects.instance [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lazy-loading 'services' on Instance uuid 2bae2f38-fd5e-4d51-be63-22bbf54cd77a {{(pid=72494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:38:59 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-a7ba1193-25ba-4a28-9a8d-2b871616de7f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/os-volume_attachments/04e2cfac-63fa-480c-a8bd-f583809971ab" status: 202 len: 0 microversion: 2.1 time: 0.177586 Apr 12 00:38:59 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 174/524] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 00:38:59 2023] DELETE /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/os-volume_attachments/04e2cfac-63fa-480c-a8bd-f583809971ab => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:38:59 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-deb9e7b1-a9eb-4052-b729-544eea496c06 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:38:59 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-deb9e7b1-a9eb-4052-b729-544eea496c06 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:38:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-deb9e7b1-a9eb-4052-b729-544eea496c06 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-deb9e7b1-a9eb-4052-b729-544eea496c06 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-deb9e7b1-a9eb-4052-b729-544eea496c06 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-deb9e7b1-a9eb-4052-b729-544eea496c06 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-deb9e7b1-a9eb-4052-b729-544eea496c06 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-deb9e7b1-a9eb-4052-b729-544eea496c06 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:59 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-deb9e7b1-a9eb-4052-b729-544eea496c06 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045928 Apr 12 00:38:59 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 173/525] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:38:59 2023] GET /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:38:59 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-8ac4faba-b327-43dc-a20b-8b6da1b572c2 req-4e7fbee0-ba4a-4618-91dd-f444ca1e54e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe6d6bc-65a6-469a-89a0-7e4c51620b14", "name": "network-vif-plugged", "status": "completed", "tag": "b99b54c2-0b21-42ea-91d0-087aa230da7e"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:38:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-8ac4faba-b327-43dc-a20b-8b6da1b572c2 req-4e7fbee0-ba4a-4618-91dd-f444ca1e54e1 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:38:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-8ac4faba-b327-43dc-a20b-8b6da1b572c2 req-4e7fbee0-ba4a-4618-91dd-f444ca1e54e1 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:38:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-8ac4faba-b327-43dc-a20b-8b6da1b572c2 req-4e7fbee0-ba4a-4618-91dd-f444ca1e54e1 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:38:59 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=38 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:38:59 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-8ac4faba-b327-43dc-a20b-8b6da1b572c2 req-4e7fbee0-ba4a-4618-91dd-f444ca1e54e1 service nova] Creating event network-vif-plugged:b99b54c2-0b21-42ea-91d0-087aa230da7e for instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 on user Apr 12 00:38:59 user devstack@n-api.service[72496]: DEBUG nova.compute.api [req-8ac4faba-b327-43dc-a20b-8b6da1b572c2 req-4e7fbee0-ba4a-4618-91dd-f444ca1e54e1 service nova] Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72496) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 00:38:59 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-8ac4faba-b327-43dc-a20b-8b6da1b572c2 req-4e7fbee0-ba4a-4618-91dd-f444ca1e54e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059931 Apr 12 00:38:59 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 179/526] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:38:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:39:02 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-1d0691dc-45bf-4411-8c9a-4d1a73858421 req-30a40a56-954c-4a2b-9e44-0289bee03ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe6d6bc-65a6-469a-89a0-7e4c51620b14", "name": "network-vif-plugged", "status": "completed", "tag": "b99b54c2-0b21-42ea-91d0-087aa230da7e"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:39:02 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-1d0691dc-45bf-4411-8c9a-4d1a73858421 req-30a40a56-954c-4a2b-9e44-0289bee03ca1 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:02 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-1d0691dc-45bf-4411-8c9a-4d1a73858421 req-30a40a56-954c-4a2b-9e44-0289bee03ca1 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:02 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-1d0691dc-45bf-4411-8c9a-4d1a73858421 req-30a40a56-954c-4a2b-9e44-0289bee03ca1 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:02 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-1d0691dc-45bf-4411-8c9a-4d1a73858421 req-30a40a56-954c-4a2b-9e44-0289bee03ca1 service nova] Creating event network-vif-plugged:b99b54c2-0b21-42ea-91d0-087aa230da7e for instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 on user Apr 12 00:39:02 user devstack@n-api.service[72494]: DEBUG nova.compute.api [req-1d0691dc-45bf-4411-8c9a-4d1a73858421 req-30a40a56-954c-4a2b-9e44-0289bee03ca1 service nova] Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 00:39:02 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-1d0691dc-45bf-4411-8c9a-4d1a73858421 req-30a40a56-954c-4a2b-9e44-0289bee03ca1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038017 Apr 12 00:39:02 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 175/527] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:39:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:39:08 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-eaed873b-a809-4aea-b635-a2d93eb5ef2f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:08 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-eaed873b-a809-4aea-b635-a2d93eb5ef2f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:39:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-eaed873b-a809-4aea-b635-a2d93eb5ef2f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-eaed873b-a809-4aea-b635-a2d93eb5ef2f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-eaed873b-a809-4aea-b635-a2d93eb5ef2f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-eaed873b-a809-4aea-b635-a2d93eb5ef2f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-eaed873b-a809-4aea-b635-a2d93eb5ef2f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-eaed873b-a809-4aea-b635-a2d93eb5ef2f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:09 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-eaed873b-a809-4aea-b635-a2d93eb5ef2f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9421443b2f421298a934122c6a8b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf1fea74ef143e6b394e41e7c4ed495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:39:09 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-eaed873b-a809-4aea-b635-a2d93eb5ef2f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d" status: 200 len: 1553 microversion: 2.1 time: 0.163212 Apr 12 00:39:09 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 174/528] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:39:08 2023] GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:39:16 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:39:16 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=3 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:39:16 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-855e17bd-4856-4d11-b9d8-0c1ffb4a164c tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:16 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-855e17bd-4856-4d11-b9d8-0c1ffb4a164c tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] [instance: ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:39:16 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-855e17bd-4856-4d11-b9d8-0c1ffb4a164c tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:16 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-855e17bd-4856-4d11-b9d8-0c1ffb4a164c tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:16 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-855e17bd-4856-4d11-b9d8-0c1ffb4a164c tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:16 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-855e17bd-4856-4d11-b9d8-0c1ffb4a164c tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:16 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-855e17bd-4856-4d11-b9d8-0c1ffb4a164c tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:16 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-855e17bd-4856-4d11-b9d8-0c1ffb4a164c tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:16 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-855e17bd-4856-4d11-b9d8-0c1ffb4a164c tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] HTTP exception thrown: Instance ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 could not be found. Apr 12 00:39:16 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-855e17bd-4856-4d11-b9d8-0c1ffb4a164c tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Request method failure captured: Apr 12 00:39:16 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 HTTP/1.1 Apr 12 00:39:16 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:39:16 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:39:16 user devstack@n-api.service[72496]: Connection: close Apr 12 00:39:16 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:39:16 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:39:16 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:39:16 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:39:16 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:39:16 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNft1qKkmjD8Nll-qUgF19N1LJeB8PdcRbdn5Uq6buO7cPBS5Ov8OoI4tZ5vt-jvCknrLUCUXFnwniWtwxerLQ3Ye5xXh85fQ6mUUIOhguVUuxf5ZIys8tRE0XamxX86aNJtrX6fu_BHxUNtwTPq_PEt8q2KNpjT1y3XmuQXDJ2yaqus Apr 12 00:39:16 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:39:16 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:39:16 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:39:16 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:39:16 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:39:16 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:39:16 user devstack@n-api.service[72496]: X-Project-Id: 6ee31cdc6f4e4c2b9a8ec1e1c5076010 Apr 12 00:39:16 user devstack@n-api.service[72496]: X-Project-Name: tempest-ServersNegativeTestJSON-103053763 Apr 12 00:39:16 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:39:16 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:39:16 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ee31cdc6f4e4c2b9a8ec1e1c5076010"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6ee31cdc6f4e4c2b9a8ec1e1c5076010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ee31cdc6f4e4c2b9a8ec1e1c5076010"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:39:16 user devstack@n-api.service[72496]: X-Tenant: tempest-ServersNegativeTestJSON-103053763 Apr 12 00:39:16 user devstack@n-api.service[72496]: X-Tenant-Id: 6ee31cdc6f4e4c2b9a8ec1e1c5076010 Apr 12 00:39:16 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-ServersNegativeTestJSON-103053763 Apr 12 00:39:16 user devstack@n-api.service[72496]: X-User: tempest-ServersNegativeTestJSON-103053763-project-member Apr 12 00:39:16 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:39:16 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:39:16 user devstack@n-api.service[72496]: X-User-Id: 920d6d79e38e45fcb5153e712605764f Apr 12 00:39:16 user devstack@n-api.service[72496]: X-User-Name: tempest-ServersNegativeTestJSON-103053763-project-member Apr 12 00:39:16 user devstack@n-api.service[72496]: method: > Apr 12 00:39:16 user devstack@n-api.service[72496]: exception: Instance ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 could not be found. Apr 12 00:39:16 user devstack@n-api.service[72496]: action_args: {'id': 'ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9'} Apr 12 00:39:16 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 could not be found. Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 could not be found. Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 could not be found. Apr 12 00:39:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:39:16 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-855e17bd-4856-4d11-b9d8-0c1ffb4a164c tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] Returning 404 to user: Instance ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:39:16 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-855e17bd-4856-4d11-b9d8-0c1ffb4a164c tempest-ServersNegativeTestJSON-103053763 tempest-ServersNegativeTestJSON-103053763-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9" status: 404 len: 111 microversion: 2.1 time: 0.037024 Apr 12 00:39:16 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 180/529] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:39:16 2023] GET /compute/v2.1/servers/ef094ff9-cccb-48d4-b5aa-dbb2ba0d9ee9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:39:17 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=3 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:39:17 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:39:17 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-53ab1de8-16a0-4b28-ad1f-9b8ba56c16de tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:17 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-53ab1de8-16a0-4b28-ad1f-9b8ba56c16de tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:39:17 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-53ab1de8-16a0-4b28-ad1f-9b8ba56c16de tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:17 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-53ab1de8-16a0-4b28-ad1f-9b8ba56c16de tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:17 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-53ab1de8-16a0-4b28-ad1f-9b8ba56c16de tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:17 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-53ab1de8-16a0-4b28-ad1f-9b8ba56c16de tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:17 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-53ab1de8-16a0-4b28-ad1f-9b8ba56c16de tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:17 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-53ab1de8-16a0-4b28-ad1f-9b8ba56c16de tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:17 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-53ab1de8-16a0-4b28-ad1f-9b8ba56c16de tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] HTTP exception thrown: Instance d8833bad-d30f-4cd4-aa66-10d60c782061 could not be found. Apr 12 00:39:17 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-53ab1de8-16a0-4b28-ad1f-9b8ba56c16de tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Request method failure captured: Apr 12 00:39:17 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/d8833bad-d30f-4cd4-aa66-10d60c782061 HTTP/1.1 Apr 12 00:39:17 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:39:17 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:39:17 user devstack@n-api.service[72494]: Connection: close Apr 12 00:39:17 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:39:17 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:39:17 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:39:17 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:39:17 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:39:17 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNfut1jPVwgpnHF2p4IDb8mw8QCnmrhPi1bglXERi9o-oc8KfA86Nj8qbMXqGPJ-Qu-hg1buox-hKkUkiuJLGP2TjR-hKqepkY3sMZyNoxK3mS9Lgsu4E_4fnuzEqTUjrpCZSmbPFt9R2omKh-uhIkWfp0X1fr8C_wHlflXHVBJsAvYQ Apr 12 00:39:17 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:39:17 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:39:17 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:39:17 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:39:17 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:39:17 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:39:17 user devstack@n-api.service[72494]: X-Project-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:39:17 user devstack@n-api.service[72494]: X-Project-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:39:17 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:39:17 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:39:17 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:39:17 user devstack@n-api.service[72494]: X-Tenant: tempest-TestVolumeBootPattern-726466832 Apr 12 00:39:17 user devstack@n-api.service[72494]: X-Tenant-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:39:17 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:39:17 user devstack@n-api.service[72494]: X-User: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:39:17 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:39:17 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:39:17 user devstack@n-api.service[72494]: X-User-Id: c479f6ae2f0d40908be9b07717ca3509 Apr 12 00:39:17 user devstack@n-api.service[72494]: X-User-Name: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:39:17 user devstack@n-api.service[72494]: method: > Apr 12 00:39:17 user devstack@n-api.service[72494]: exception: Instance d8833bad-d30f-4cd4-aa66-10d60c782061 could not be found. Apr 12 00:39:17 user devstack@n-api.service[72494]: action_args: {'id': 'd8833bad-d30f-4cd4-aa66-10d60c782061'} Apr 12 00:39:17 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8833bad-d30f-4cd4-aa66-10d60c782061 could not be found. Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8833bad-d30f-4cd4-aa66-10d60c782061 could not be found. Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8833bad-d30f-4cd4-aa66-10d60c782061 could not be found. Apr 12 00:39:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:39:17 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-53ab1de8-16a0-4b28-ad1f-9b8ba56c16de tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Returning 404 to user: Instance d8833bad-d30f-4cd4-aa66-10d60c782061 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:39:17 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-53ab1de8-16a0-4b28-ad1f-9b8ba56c16de tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8833bad-d30f-4cd4-aa66-10d60c782061" status: 404 len: 111 microversion: 2.1 time: 0.042025 Apr 12 00:39:17 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 176/530] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:39:17 2023] GET /compute/v2.1/servers/d8833bad-d30f-4cd4-aa66-10d60c782061 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:39:17 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-c0601fd9-902a-4118-a646-7b31172e2630 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:17 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-c0601fd9-902a-4118-a646-7b31172e2630 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:39:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c0601fd9-902a-4118-a646-7b31172e2630 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c0601fd9-902a-4118-a646-7b31172e2630 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c0601fd9-902a-4118-a646-7b31172e2630 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c0601fd9-902a-4118-a646-7b31172e2630 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c0601fd9-902a-4118-a646-7b31172e2630 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c0601fd9-902a-4118-a646-7b31172e2630 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:17 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-c0601fd9-902a-4118-a646-7b31172e2630 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] HTTP exception thrown: Instance ba310127-67a9-4245-87f6-555e35f30a16 could not be found. Apr 12 00:39:17 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-c0601fd9-902a-4118-a646-7b31172e2630 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Request method failure captured: Apr 12 00:39:17 user devstack@n-api.service[72495]: request: DELETE /compute/v2.1/servers/ba310127-67a9-4245-87f6-555e35f30a16 HTTP/1.1 Apr 12 00:39:17 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:39:17 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:39:17 user devstack@n-api.service[72495]: Connection: close Apr 12 00:39:17 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 00:39:17 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:39:17 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:39:17 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:39:17 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:39:17 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNfut1jPVwgpnHF2p4IDb8mw8QCnmrhPi1bglXERi9o-oc8KfA86Nj8qbMXqGPJ-Qu-hg1buox-hKkUkiuJLGP2TjR-hKqepkY3sMZyNoxK3mS9Lgsu4E_4fnuzEqTUjrpCZSmbPFt9R2omKh-uhIkWfp0X1fr8C_wHlflXHVBJsAvYQ Apr 12 00:39:17 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:39:17 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:39:17 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:39:17 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:39:17 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:39:17 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:39:17 user devstack@n-api.service[72495]: X-Project-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:39:17 user devstack@n-api.service[72495]: X-Project-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:39:17 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:39:17 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:39:17 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:39:17 user devstack@n-api.service[72495]: X-Tenant: tempest-TestVolumeBootPattern-726466832 Apr 12 00:39:17 user devstack@n-api.service[72495]: X-Tenant-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:39:17 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:39:17 user devstack@n-api.service[72495]: X-User: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:39:17 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:39:17 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:39:17 user devstack@n-api.service[72495]: X-User-Id: c479f6ae2f0d40908be9b07717ca3509 Apr 12 00:39:17 user devstack@n-api.service[72495]: X-User-Name: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:39:17 user devstack@n-api.service[72495]: method: > Apr 12 00:39:17 user devstack@n-api.service[72495]: exception: Instance ba310127-67a9-4245-87f6-555e35f30a16 could not be found. Apr 12 00:39:17 user devstack@n-api.service[72495]: action_args: {'id': 'ba310127-67a9-4245-87f6-555e35f30a16'} Apr 12 00:39:17 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba310127-67a9-4245-87f6-555e35f30a16 could not be found. Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba310127-67a9-4245-87f6-555e35f30a16 could not be found. Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba310127-67a9-4245-87f6-555e35f30a16 could not be found. Apr 12 00:39:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:39:17 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-c0601fd9-902a-4118-a646-7b31172e2630 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Returning 404 to user: Instance ba310127-67a9-4245-87f6-555e35f30a16 could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:39:17 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-c0601fd9-902a-4118-a646-7b31172e2630 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ba310127-67a9-4245-87f6-555e35f30a16" status: 404 len: 111 microversion: 2.1 time: 0.035102 Apr 12 00:39:17 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 175/531] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:39:17 2023] DELETE /compute/v2.1/servers/ba310127-67a9-4245-87f6-555e35f30a16 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:39:17 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-cd213960-b503-4aea-bea5-0515c90bc385 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:17 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-cd213960-b503-4aea-bea5-0515c90bc385 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ba310127-67a9-4245-87f6-555e35f30a16] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:39:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-cd213960-b503-4aea-bea5-0515c90bc385 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-cd213960-b503-4aea-bea5-0515c90bc385 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-cd213960-b503-4aea-bea5-0515c90bc385 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-cd213960-b503-4aea-bea5-0515c90bc385 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-cd213960-b503-4aea-bea5-0515c90bc385 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-cd213960-b503-4aea-bea5-0515c90bc385 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:17 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-cd213960-b503-4aea-bea5-0515c90bc385 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] HTTP exception thrown: Instance ba310127-67a9-4245-87f6-555e35f30a16 could not be found. Apr 12 00:39:17 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-cd213960-b503-4aea-bea5-0515c90bc385 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Request method failure captured: Apr 12 00:39:17 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/ba310127-67a9-4245-87f6-555e35f30a16 HTTP/1.1 Apr 12 00:39:17 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:39:17 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:39:17 user devstack@n-api.service[72496]: Connection: close Apr 12 00:39:17 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:39:17 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:39:17 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:39:17 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:39:17 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:39:17 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNfut1jPVwgpnHF2p4IDb8mw8QCnmrhPi1bglXERi9o-oc8KfA86Nj8qbMXqGPJ-Qu-hg1buox-hKkUkiuJLGP2TjR-hKqepkY3sMZyNoxK3mS9Lgsu4E_4fnuzEqTUjrpCZSmbPFt9R2omKh-uhIkWfp0X1fr8C_wHlflXHVBJsAvYQ Apr 12 00:39:17 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:39:17 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:39:17 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:39:17 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:39:17 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:39:17 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:39:17 user devstack@n-api.service[72496]: X-Project-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:39:17 user devstack@n-api.service[72496]: X-Project-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:39:17 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:39:17 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:39:17 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:39:17 user devstack@n-api.service[72496]: X-Tenant: tempest-TestVolumeBootPattern-726466832 Apr 12 00:39:17 user devstack@n-api.service[72496]: X-Tenant-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:39:17 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:39:17 user devstack@n-api.service[72496]: X-User: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:39:17 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:39:17 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:39:17 user devstack@n-api.service[72496]: X-User-Id: c479f6ae2f0d40908be9b07717ca3509 Apr 12 00:39:17 user devstack@n-api.service[72496]: X-User-Name: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:39:17 user devstack@n-api.service[72496]: method: > Apr 12 00:39:17 user devstack@n-api.service[72496]: exception: Instance ba310127-67a9-4245-87f6-555e35f30a16 could not be found. Apr 12 00:39:17 user devstack@n-api.service[72496]: action_args: {'id': 'ba310127-67a9-4245-87f6-555e35f30a16'} Apr 12 00:39:17 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba310127-67a9-4245-87f6-555e35f30a16 could not be found. Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba310127-67a9-4245-87f6-555e35f30a16 could not be found. Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba310127-67a9-4245-87f6-555e35f30a16 could not be found. Apr 12 00:39:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:39:17 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-cd213960-b503-4aea-bea5-0515c90bc385 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Returning 404 to user: Instance ba310127-67a9-4245-87f6-555e35f30a16 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:39:17 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-cd213960-b503-4aea-bea5-0515c90bc385 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ba310127-67a9-4245-87f6-555e35f30a16" status: 404 len: 111 microversion: 2.1 time: 0.029561 Apr 12 00:39:17 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 181/532] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:39:17 2023] GET /compute/v2.1/servers/ba310127-67a9-4245-87f6-555e35f30a16 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:39:18 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-676496a5-7f5c-4b5d-b9cf-786fb574d230 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:18 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-676496a5-7f5c-4b5d-b9cf-786fb574d230 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:39:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-676496a5-7f5c-4b5d-b9cf-786fb574d230 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-676496a5-7f5c-4b5d-b9cf-786fb574d230 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-676496a5-7f5c-4b5d-b9cf-786fb574d230 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-676496a5-7f5c-4b5d-b9cf-786fb574d230 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-676496a5-7f5c-4b5d-b9cf-786fb574d230 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-676496a5-7f5c-4b5d-b9cf-786fb574d230 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:18 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-676496a5-7f5c-4b5d-b9cf-786fb574d230 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] HTTP exception thrown: Instance d8833bad-d30f-4cd4-aa66-10d60c782061 could not be found. Apr 12 00:39:18 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-676496a5-7f5c-4b5d-b9cf-786fb574d230 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Request method failure captured: Apr 12 00:39:18 user devstack@n-api.service[72494]: request: DELETE /compute/v2.1/servers/d8833bad-d30f-4cd4-aa66-10d60c782061 HTTP/1.1 Apr 12 00:39:18 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:39:18 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:39:18 user devstack@n-api.service[72494]: Connection: close Apr 12 00:39:18 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:39:18 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:39:18 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:39:18 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:39:18 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:39:18 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNfut1jPVwgpnHF2p4IDb8mw8QCnmrhPi1bglXERi9o-oc8KfA86Nj8qbMXqGPJ-Qu-hg1buox-hKkUkiuJLGP2TjR-hKqepkY3sMZyNoxK3mS9Lgsu4E_4fnuzEqTUjrpCZSmbPFt9R2omKh-uhIkWfp0X1fr8C_wHlflXHVBJsAvYQ Apr 12 00:39:18 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:39:18 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:39:18 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:39:18 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:39:18 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:39:18 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:39:18 user devstack@n-api.service[72494]: X-Project-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:39:18 user devstack@n-api.service[72494]: X-Project-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:39:18 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:39:18 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:39:18 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:39:18 user devstack@n-api.service[72494]: X-Tenant: tempest-TestVolumeBootPattern-726466832 Apr 12 00:39:18 user devstack@n-api.service[72494]: X-Tenant-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:39:18 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:39:18 user devstack@n-api.service[72494]: X-User: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:39:18 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:39:18 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:39:18 user devstack@n-api.service[72494]: X-User-Id: c479f6ae2f0d40908be9b07717ca3509 Apr 12 00:39:18 user devstack@n-api.service[72494]: X-User-Name: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:39:18 user devstack@n-api.service[72494]: method: > Apr 12 00:39:18 user devstack@n-api.service[72494]: exception: Instance d8833bad-d30f-4cd4-aa66-10d60c782061 could not be found. Apr 12 00:39:18 user devstack@n-api.service[72494]: action_args: {'id': 'd8833bad-d30f-4cd4-aa66-10d60c782061'} Apr 12 00:39:18 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8833bad-d30f-4cd4-aa66-10d60c782061 could not be found. Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8833bad-d30f-4cd4-aa66-10d60c782061 could not be found. Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8833bad-d30f-4cd4-aa66-10d60c782061 could not be found. Apr 12 00:39:18 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:39:18 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-676496a5-7f5c-4b5d-b9cf-786fb574d230 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Returning 404 to user: Instance d8833bad-d30f-4cd4-aa66-10d60c782061 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:39:18 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-676496a5-7f5c-4b5d-b9cf-786fb574d230 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d8833bad-d30f-4cd4-aa66-10d60c782061" status: 404 len: 111 microversion: 2.1 time: 0.029109 Apr 12 00:39:18 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 177/533] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:39:18 2023] DELETE /compute/v2.1/servers/d8833bad-d30f-4cd4-aa66-10d60c782061 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:39:18 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-f499a41b-edbf-4e6f-b07c-e922e56c1f55 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:18 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-f499a41b-edbf-4e6f-b07c-e922e56c1f55 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: d8833bad-d30f-4cd4-aa66-10d60c782061] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:39:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-f499a41b-edbf-4e6f-b07c-e922e56c1f55 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-f499a41b-edbf-4e6f-b07c-e922e56c1f55 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-f499a41b-edbf-4e6f-b07c-e922e56c1f55 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-f499a41b-edbf-4e6f-b07c-e922e56c1f55 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-f499a41b-edbf-4e6f-b07c-e922e56c1f55 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-f499a41b-edbf-4e6f-b07c-e922e56c1f55 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:18 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-f499a41b-edbf-4e6f-b07c-e922e56c1f55 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] HTTP exception thrown: Instance d8833bad-d30f-4cd4-aa66-10d60c782061 could not be found. Apr 12 00:39:18 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-f499a41b-edbf-4e6f-b07c-e922e56c1f55 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Request method failure captured: Apr 12 00:39:18 user devstack@n-api.service[72495]: request: GET /compute/v2.1/servers/d8833bad-d30f-4cd4-aa66-10d60c782061 HTTP/1.1 Apr 12 00:39:18 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:39:18 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:39:18 user devstack@n-api.service[72495]: Connection: close Apr 12 00:39:18 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 00:39:18 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:39:18 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:39:18 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:39:18 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:39:18 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNfut1jPVwgpnHF2p4IDb8mw8QCnmrhPi1bglXERi9o-oc8KfA86Nj8qbMXqGPJ-Qu-hg1buox-hKkUkiuJLGP2TjR-hKqepkY3sMZyNoxK3mS9Lgsu4E_4fnuzEqTUjrpCZSmbPFt9R2omKh-uhIkWfp0X1fr8C_wHlflXHVBJsAvYQ Apr 12 00:39:18 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:39:18 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:39:18 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:39:18 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:39:18 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:39:18 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:39:18 user devstack@n-api.service[72495]: X-Project-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:39:18 user devstack@n-api.service[72495]: X-Project-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:39:18 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:39:18 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:39:18 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:39:18 user devstack@n-api.service[72495]: X-Tenant: tempest-TestVolumeBootPattern-726466832 Apr 12 00:39:18 user devstack@n-api.service[72495]: X-Tenant-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:39:18 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:39:18 user devstack@n-api.service[72495]: X-User: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:39:18 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:39:18 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:39:18 user devstack@n-api.service[72495]: X-User-Id: c479f6ae2f0d40908be9b07717ca3509 Apr 12 00:39:18 user devstack@n-api.service[72495]: X-User-Name: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:39:18 user devstack@n-api.service[72495]: method: > Apr 12 00:39:18 user devstack@n-api.service[72495]: exception: Instance d8833bad-d30f-4cd4-aa66-10d60c782061 could not be found. Apr 12 00:39:18 user devstack@n-api.service[72495]: action_args: {'id': 'd8833bad-d30f-4cd4-aa66-10d60c782061'} Apr 12 00:39:18 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8833bad-d30f-4cd4-aa66-10d60c782061 could not be found. Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8833bad-d30f-4cd4-aa66-10d60c782061 could not be found. Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8833bad-d30f-4cd4-aa66-10d60c782061 could not be found. Apr 12 00:39:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:39:18 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-f499a41b-edbf-4e6f-b07c-e922e56c1f55 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Returning 404 to user: Instance d8833bad-d30f-4cd4-aa66-10d60c782061 could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:39:18 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-f499a41b-edbf-4e6f-b07c-e922e56c1f55 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8833bad-d30f-4cd4-aa66-10d60c782061" status: 404 len: 111 microversion: 2.1 time: 0.026969 Apr 12 00:39:18 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 176/534] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:39:18 2023] GET /compute/v2.1/servers/d8833bad-d30f-4cd4-aa66-10d60c782061 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:39:18 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-1f473856-757a-4010-900b-9389b37b138e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Action: 'create', calling method: .version_select at 0x7f7cd4623760>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1592613584", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHLKfgUN7BKp84PunZzyDASd7PA4FzJd5Qn6C/rqYS3mNHGpIxg5kY6qQwY5cbt/1yU76kBro1l/6u/KDAhYs1EkVUTqrubOTo+RJq3UAoEyXCaFp7GZethakZ3d/IoYQ=="}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:39:18 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-1f473856-757a-4010-900b-9389b37b138e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting quotas for project e38a98bf1d964ee6bd2d0d05e97a283a. Resources: {'key_pairs'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:39:18 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-1f473856-757a-4010-900b-9389b37b138e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting quotas for user c479f6ae2f0d40908be9b07717ca3509 and project e38a98bf1d964ee6bd2d0d05e97a283a. Resources: {'key_pairs'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:39:18 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-1f473856-757a-4010-900b-9389b37b138e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.057459 Apr 12 00:39:18 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 182/535] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 00:39:18 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:39:20 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-1326f373-4f3b-4a3e-954f-63d918b17c6c tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:20 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-1326f373-4f3b-4a3e-954f-63d918b17c6c tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:39:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1326f373-4f3b-4a3e-954f-63d918b17c6c tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1326f373-4f3b-4a3e-954f-63d918b17c6c tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1326f373-4f3b-4a3e-954f-63d918b17c6c tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1326f373-4f3b-4a3e-954f-63d918b17c6c tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1326f373-4f3b-4a3e-954f-63d918b17c6c tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1326f373-4f3b-4a3e-954f-63d918b17c6c tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:20 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-1326f373-4f3b-4a3e-954f-63d918b17c6c tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:39:20 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-1326f373-4f3b-4a3e-954f-63d918b17c6c tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:39:20 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-1326f373-4f3b-4a3e-954f-63d918b17c6c tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:39:20 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-1326f373-4f3b-4a3e-954f-63d918b17c6c tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1277a40a-6389-4d88-bbc6-bda27d465c35" status: 200 len: 1754 microversion: 2.87 time: 0.345111 Apr 12 00:39:20 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 178/536] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:39:20 2023] GET /compute/v2.1/servers/1277a40a-6389-4d88-bbc6-bda27d465c35 => generated 1754 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:39:22 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1445873100", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1592613584", "security_groups": [{"name": "tempest-secgroup-smoke-1090038461"}], "block_device_mapping_v2": [{"uuid": "39255a99-7938-4a08-af09-fe2d718c4fda", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "159bca51-de37-4d87-9af5-ec97816a869c"}]}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:39:22 user devstack@n-api.service[72495]: DEBUG nova.network.neutron [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] validate_networks() for [('159bca51-de37-4d87-9af5-ec97816a869c', None, None, None, None, None)] {{(pid=72495) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:39:23 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flavor limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:39:23 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Image limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:39:23 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flavor pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:39:23 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Image pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:39:23 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:39:23 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:23 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:23 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:23 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:23 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:23 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:23 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting quotas for project e38a98bf1d964ee6bd2d0d05e97a283a. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:39:23 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting quotas for user c479f6ae2f0d40908be9b07717ca3509 and project e38a98bf1d964ee6bd2d0d05e97a283a. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:39:23 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Going to run 1 instances... {{(pid=72495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:39:23 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='39255a99-7938-4a08-af09-fe2d718c4fda',volume_size=None,volume_type=None)] {{(pid=72495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:39:23 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-1fb8177b-4a4a-4680-bd18-92ea1626bb8a tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.086879 Apr 12 00:39:23 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 177/537] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:39:22 2023] POST /compute/v2.1/servers => generated 404 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:39:23 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-952822d5-348b-4926-a58a-0dcccf1687a7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:23 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-952822d5-348b-4926-a58a-0dcccf1687a7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:39:23 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-952822d5-348b-4926-a58a-0dcccf1687a7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:39:23 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-952822d5-348b-4926-a58a-0dcccf1687a7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ecfc9ba1-d560-410d-af55-8d5e578aa00d" status: 200 len: 1090 microversion: 2.1 time: 0.092223 Apr 12 00:39:23 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 183/538] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:39:23 2023] GET /compute/v2.1/servers/ecfc9ba1-d560-410d-af55-8d5e578aa00d => generated 1090 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:39:24 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:24 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:39:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:24 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Going to try to terminate instance {{(pid=72494) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:39:24 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-7b599c38-4718-449e-b569-1537dedbc0ab tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/daa798af-8437-4083-b73c-92b0cb39d861" status: 204 len: 0 microversion: 2.1 time: 0.171247 Apr 12 00:39:24 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 179/539] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:39:24 2023] DELETE /compute/v2.1/servers/daa798af-8437-4083-b73c-92b0cb39d861 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:39:24 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-088db5ed-5dd7-42db-be2e-030b4531ddd0 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:24 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-088db5ed-5dd7-42db-be2e-030b4531ddd0 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:39:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-088db5ed-5dd7-42db-be2e-030b4531ddd0 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-088db5ed-5dd7-42db-be2e-030b4531ddd0 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-088db5ed-5dd7-42db-be2e-030b4531ddd0 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-088db5ed-5dd7-42db-be2e-030b4531ddd0 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-088db5ed-5dd7-42db-be2e-030b4531ddd0 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-088db5ed-5dd7-42db-be2e-030b4531ddd0 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:24 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-088db5ed-5dd7-42db-be2e-030b4531ddd0 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7724cf4de81c4147929f43fd8744e8f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6cebaed9654692bd9aef950a08741b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:39:24 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-088db5ed-5dd7-42db-be2e-030b4531ddd0 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] 10.0.0.210 "GET /compute/v2.1/servers/daa798af-8437-4083-b73c-92b0cb39d861" status: 200 len: 1459 microversion: 2.1 time: 0.303544 Apr 12 00:39:24 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 178/540] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:39:24 2023] GET /compute/v2.1/servers/daa798af-8437-4083-b73c-92b0cb39d861 => generated 1459 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:39:24 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-750dd1d3-6489-4b7c-a3a2-979a91a24c5d req-33a35269-edad-4e5e-9443-e389aca8351b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa798af-8437-4083-b73c-92b0cb39d861", "name": "network-vif-unplugged", "status": "completed", "tag": "204e9845-040e-4b8d-a957-b70dd44b340b"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:39:24 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-750dd1d3-6489-4b7c-a3a2-979a91a24c5d req-33a35269-edad-4e5e-9443-e389aca8351b service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:24 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-750dd1d3-6489-4b7c-a3a2-979a91a24c5d req-33a35269-edad-4e5e-9443-e389aca8351b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:24 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-750dd1d3-6489-4b7c-a3a2-979a91a24c5d req-33a35269-edad-4e5e-9443-e389aca8351b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:24 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-750dd1d3-6489-4b7c-a3a2-979a91a24c5d req-33a35269-edad-4e5e-9443-e389aca8351b service nova] Creating event network-vif-unplugged:204e9845-040e-4b8d-a957-b70dd44b340b for instance daa798af-8437-4083-b73c-92b0cb39d861 on user Apr 12 00:39:24 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-750dd1d3-6489-4b7c-a3a2-979a91a24c5d req-33a35269-edad-4e5e-9443-e389aca8351b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042882 Apr 12 00:39:24 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 184/541] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:39:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:39:26 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-203684a7-58f7-49ec-8e1f-20aff69cdd58 req-79c01635-9d69-423d-b6d3-4f77070675ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa798af-8437-4083-b73c-92b0cb39d861", "name": "network-vif-deleted", "tag": "204e9845-040e-4b8d-a957-b70dd44b340b"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:39:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-203684a7-58f7-49ec-8e1f-20aff69cdd58 req-79c01635-9d69-423d-b6d3-4f77070675ed service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-203684a7-58f7-49ec-8e1f-20aff69cdd58 req-79c01635-9d69-423d-b6d3-4f77070675ed service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-203684a7-58f7-49ec-8e1f-20aff69cdd58 req-79c01635-9d69-423d-b6d3-4f77070675ed service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:26 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-203684a7-58f7-49ec-8e1f-20aff69cdd58 req-79c01635-9d69-423d-b6d3-4f77070675ed service nova] Creating event network-vif-deleted:204e9845-040e-4b8d-a957-b70dd44b340b for instance daa798af-8437-4083-b73c-92b0cb39d861 on user Apr 12 00:39:26 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-203684a7-58f7-49ec-8e1f-20aff69cdd58 req-79c01635-9d69-423d-b6d3-4f77070675ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033772 Apr 12 00:39:26 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 180/542] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:39:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:39:26 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa798af-8437-4083-b73c-92b0cb39d861", "name": "network-vif-plugged", "status": "completed", "tag": "204e9845-040e-4b8d-a957-b70dd44b340b"}, {"server_uuid": "daa798af-8437-4083-b73c-92b0cb39d861", "name": "network-vif-plugged", "status": "completed", "tag": "204e9845-040e-4b8d-a957-b70dd44b340b"}, {"server_uuid": "daa798af-8437-4083-b73c-92b0cb39d861", "name": "network-vif-plugged", "status": "completed", "tag": "204e9845-040e-4b8d-a957-b70dd44b340b"}, {"server_uuid": "daa798af-8437-4083-b73c-92b0cb39d861", "name": "network-vif-unplugged", "status": "completed", "tag": "204e9845-040e-4b8d-a957-b70dd44b340b"}, {"server_uuid": "daa798af-8437-4083-b73c-92b0cb39d861", "name": "network-vif-plugged", "status": "completed", "tag": "204e9845-040e-4b8d-a957-b70dd44b340b"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:39:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:26 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] Creating event network-vif-plugged:204e9845-040e-4b8d-a957-b70dd44b340b for instance daa798af-8437-4083-b73c-92b0cb39d861 on user Apr 12 00:39:26 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] Creating event network-vif-plugged:204e9845-040e-4b8d-a957-b70dd44b340b for instance daa798af-8437-4083-b73c-92b0cb39d861 on user Apr 12 00:39:26 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] Creating event network-vif-plugged:204e9845-040e-4b8d-a957-b70dd44b340b for instance daa798af-8437-4083-b73c-92b0cb39d861 on user Apr 12 00:39:26 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] Creating event network-vif-unplugged:204e9845-040e-4b8d-a957-b70dd44b340b for instance daa798af-8437-4083-b73c-92b0cb39d861 on user Apr 12 00:39:26 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] Creating event network-vif-plugged:204e9845-040e-4b8d-a957-b70dd44b340b for instance daa798af-8437-4083-b73c-92b0cb39d861 on user Apr 12 00:39:26 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-e8daa6d3-f6a1-46d0-9941-5bdce95a0273 req-2c75f72a-32cb-431a-ad86-314173a183cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.050325 Apr 12 00:39:26 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 179/543] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:39:26 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:39:28 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-401c8eb3-d839-4edc-81d0-200b05470454 req-a5edb3e9-e150-46a9-a239-b3944a835dfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecfc9ba1-d560-410d-af55-8d5e578aa00d", "tag": "d71af90a-89b8-414c-9bac-b2a9605aeec5"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:39:28 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-401c8eb3-d839-4edc-81d0-200b05470454 req-a5edb3e9-e150-46a9-a239-b3944a835dfa service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:28 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-401c8eb3-d839-4edc-81d0-200b05470454 req-a5edb3e9-e150-46a9-a239-b3944a835dfa service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:28 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-401c8eb3-d839-4edc-81d0-200b05470454 req-a5edb3e9-e150-46a9-a239-b3944a835dfa service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:28 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-401c8eb3-d839-4edc-81d0-200b05470454 req-a5edb3e9-e150-46a9-a239-b3944a835dfa service nova] Creating event network-changed:d71af90a-89b8-414c-9bac-b2a9605aeec5 for instance ecfc9ba1-d560-410d-af55-8d5e578aa00d on user Apr 12 00:39:28 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-401c8eb3-d839-4edc-81d0-200b05470454 req-a5edb3e9-e150-46a9-a239-b3944a835dfa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034242 Apr 12 00:39:28 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 185/544] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:39:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:39:33 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-c69bb568-70b9-4705-b6d8-046ab28b0e9a req-865a9e34-a3cc-4a45-a32a-46122f057fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecfc9ba1-d560-410d-af55-8d5e578aa00d", "name": "network-vif-plugged", "status": "completed", "tag": "d71af90a-89b8-414c-9bac-b2a9605aeec5"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:39:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-c69bb568-70b9-4705-b6d8-046ab28b0e9a req-865a9e34-a3cc-4a45-a32a-46122f057fd2 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-c69bb568-70b9-4705-b6d8-046ab28b0e9a req-865a9e34-a3cc-4a45-a32a-46122f057fd2 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-c69bb568-70b9-4705-b6d8-046ab28b0e9a req-865a9e34-a3cc-4a45-a32a-46122f057fd2 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:33 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-c69bb568-70b9-4705-b6d8-046ab28b0e9a req-865a9e34-a3cc-4a45-a32a-46122f057fd2 service nova] Creating event network-vif-plugged:d71af90a-89b8-414c-9bac-b2a9605aeec5 for instance ecfc9ba1-d560-410d-af55-8d5e578aa00d on user Apr 12 00:39:33 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-c69bb568-70b9-4705-b6d8-046ab28b0e9a req-865a9e34-a3cc-4a45-a32a-46122f057fd2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055666 Apr 12 00:39:33 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 181/545] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:39:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:39:35 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:39:35 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:39:35 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-21cee90f-d854-48f3-8367-b3f8ea856057 req-c893fdab-322b-4b4d-9d3a-90b10e3fb3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecfc9ba1-d560-410d-af55-8d5e578aa00d", "name": "network-vif-plugged", "status": "completed", "tag": "d71af90a-89b8-414c-9bac-b2a9605aeec5"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:39:35 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:39:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-21cee90f-d854-48f3-8367-b3f8ea856057 req-c893fdab-322b-4b4d-9d3a-90b10e3fb3b6 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-21cee90f-d854-48f3-8367-b3f8ea856057 req-c893fdab-322b-4b4d-9d3a-90b10e3fb3b6 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-21cee90f-d854-48f3-8367-b3f8ea856057 req-c893fdab-322b-4b4d-9d3a-90b10e3fb3b6 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:35 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=28 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:39:35 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-21cee90f-d854-48f3-8367-b3f8ea856057 req-c893fdab-322b-4b4d-9d3a-90b10e3fb3b6 service nova] Creating event network-vif-plugged:d71af90a-89b8-414c-9bac-b2a9605aeec5 for instance ecfc9ba1-d560-410d-af55-8d5e578aa00d on user Apr 12 00:39:35 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-21cee90f-d854-48f3-8367-b3f8ea856057 req-c893fdab-322b-4b4d-9d3a-90b10e3fb3b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048364 Apr 12 00:39:35 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 180/546] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:39:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:39:35 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:39:35 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-ef01619a-07d8-4cf4-9cf3-f03b9e6288fd tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:35 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-ef01619a-07d8-4cf4-9cf3-f03b9e6288fd tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:39:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-ef01619a-07d8-4cf4-9cf3-f03b9e6288fd tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-ef01619a-07d8-4cf4-9cf3-f03b9e6288fd tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-ef01619a-07d8-4cf4-9cf3-f03b9e6288fd tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-ef01619a-07d8-4cf4-9cf3-f03b9e6288fd tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-ef01619a-07d8-4cf4-9cf3-f03b9e6288fd tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-ef01619a-07d8-4cf4-9cf3-f03b9e6288fd tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:36 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-ef01619a-07d8-4cf4-9cf3-f03b9e6288fd tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:39:36 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-ef01619a-07d8-4cf4-9cf3-f03b9e6288fd tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 200 len: 1730 microversion: 2.1 time: 0.360740 Apr 12 00:39:36 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 186/547] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:39:35 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 1730 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:39:44 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:39:44 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:39:44 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-41f2df6e-afa4-453a-9865-6df7d5886912 tempest-VolumesAdminNegativeTest-1980510080 tempest-VolumesAdminNegativeTest-1980510080-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "94aa6555-7217-452b-bb1d-87e68a74e62b"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:39:44 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-41f2df6e-afa4-453a-9865-6df7d5886912 tempest-VolumesAdminNegativeTest-1980510080 tempest-VolumesAdminNegativeTest-1980510080-project-admin] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:39:44 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-41f2df6e-afa4-453a-9865-6df7d5886912 tempest-VolumesAdminNegativeTest-1980510080 tempest-VolumesAdminNegativeTest-1980510080-project-admin] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:44 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-41f2df6e-afa4-453a-9865-6df7d5886912 tempest-VolumesAdminNegativeTest-1980510080 tempest-VolumesAdminNegativeTest-1980510080-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:44 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-41f2df6e-afa4-453a-9865-6df7d5886912 tempest-VolumesAdminNegativeTest-1980510080 tempest-VolumesAdminNegativeTest-1980510080-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:44 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-41f2df6e-afa4-453a-9865-6df7d5886912 tempest-VolumesAdminNegativeTest-1980510080 tempest-VolumesAdminNegativeTest-1980510080-project-admin] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:44 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-41f2df6e-afa4-453a-9865-6df7d5886912 tempest-VolumesAdminNegativeTest-1980510080 tempest-VolumesAdminNegativeTest-1980510080-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:44 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-41f2df6e-afa4-453a-9865-6df7d5886912 tempest-VolumesAdminNegativeTest-1980510080 tempest-VolumesAdminNegativeTest-1980510080-project-admin] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:44 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-41f2df6e-afa4-453a-9865-6df7d5886912 tempest-VolumesAdminNegativeTest-1980510080 tempest-VolumesAdminNegativeTest-1980510080-project-admin] HTTP exception thrown: Volume e94db36c-926f-4cd4-98fe-89f36eb80bc5 could not be found. Apr 12 00:39:44 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-41f2df6e-afa4-453a-9865-6df7d5886912 tempest-VolumesAdminNegativeTest-1980510080 tempest-VolumesAdminNegativeTest-1980510080-project-admin] Request method failure captured: Apr 12 00:39:44 user devstack@n-api.service[72494]: request: PUT /compute/v2.1/servers/f2164441-0fa4-463c-afde-a333095d0e56/os-volume_attachments/e94db36c-926f-4cd4-98fe-89f36eb80bc5 HTTP/1.1 Apr 12 00:39:44 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:39:44 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:39:44 user devstack@n-api.service[72494]: Connection: close Apr 12 00:39:44 user devstack@n-api.service[72494]: Content-Length: 74 Apr 12 00:39:44 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:39:44 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:39:44 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:39:44 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:39:44 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNfyycq7h_JK4kd7h82xEwGyq9lCMvqyyu_BcUmgTMq1rM17MTHI7xeQ-mkqVQZMzSYCjfEzpIeDIa86zF1wvjo6Xxl3bg4QTsRoXvEz9cmqT6lwx0lVPy_F0_sr26lR3yTdumMl7Wphzy8q4AoGZ3FdSAM0f4b7Ch_NKzgzC9l0azA0 Apr 12 00:39:44 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:39:44 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:39:44 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:39:44 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:39:44 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:39:44 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:39:44 user devstack@n-api.service[72494]: X-Project-Id: 92780baf42884d509917d805ab035c3e Apr 12 00:39:44 user devstack@n-api.service[72494]: X-Project-Name: tempest-VolumesAdminNegativeTest-1980510080 Apr 12 00:39:44 user devstack@n-api.service[72494]: X-Role: member,admin,reader Apr 12 00:39:44 user devstack@n-api.service[72494]: X-Roles: member,admin,reader Apr 12 00:39:44 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/92780baf42884d509917d805ab035c3e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/92780baf42884d509917d805ab035c3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/92780baf42884d509917d805ab035c3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:39:44 user devstack@n-api.service[72494]: X-Tenant: tempest-VolumesAdminNegativeTest-1980510080 Apr 12 00:39:44 user devstack@n-api.service[72494]: X-Tenant-Id: 92780baf42884d509917d805ab035c3e Apr 12 00:39:44 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1980510080 Apr 12 00:39:44 user devstack@n-api.service[72494]: X-User: tempest-VolumesAdminNegativeTest-1980510080-project-admin Apr 12 00:39:44 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:39:44 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:39:44 user devstack@n-api.service[72494]: X-User-Id: 43b614c2848e4f6b8a21f8f495adaa77 Apr 12 00:39:44 user devstack@n-api.service[72494]: X-User-Name: tempest-VolumesAdminNegativeTest-1980510080-project-admin Apr 12 00:39:44 user devstack@n-api.service[72494]: Apr 12 00:39:44 user devstack@n-api.service[72494]: {"volumeAttachment": {"volumeId": "94aa6555-7217-452b-bb1d-87e68a74e62b"}} Apr 12 00:39:44 user devstack@n-api.service[72494]: method: > Apr 12 00:39:44 user devstack@n-api.service[72494]: exception: Volume e94db36c-926f-4cd4-98fe-89f36eb80bc5 could not be found. Apr 12 00:39:44 user devstack@n-api.service[72494]: action_args: {'server_id': 'f2164441-0fa4-463c-afde-a333095d0e56', 'id': 'e94db36c-926f-4cd4-98fe-89f36eb80bc5', 'body': {'volumeAttachment': {'volumeId': '94aa6555-7217-452b-bb1d-87e68a74e62b'}}} Apr 12 00:39:44 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e94db36c-926f-4cd4-98fe-89f36eb80bc5 could not be found. (HTTP 404) (Request-ID: req-5bf6a9ee-2391-430d-b5db-9986ca262c4c) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e94db36c-926f-4cd4-98fe-89f36eb80bc5 could not be found. Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e94db36c-926f-4cd4-98fe-89f36eb80bc5 could not be found. Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e94db36c-926f-4cd4-98fe-89f36eb80bc5 could not be found. Apr 12 00:39:44 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:39:44 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-41f2df6e-afa4-453a-9865-6df7d5886912 tempest-VolumesAdminNegativeTest-1980510080 tempest-VolumesAdminNegativeTest-1980510080-project-admin] Returning 404 to user: Volume e94db36c-926f-4cd4-98fe-89f36eb80bc5 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:39:44 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-41f2df6e-afa4-453a-9865-6df7d5886912 tempest-VolumesAdminNegativeTest-1980510080 tempest-VolumesAdminNegativeTest-1980510080-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/f2164441-0fa4-463c-afde-a333095d0e56/os-volume_attachments/e94db36c-926f-4cd4-98fe-89f36eb80bc5" status: 404 len: 109 microversion: 2.1 time: 0.215904 Apr 12 00:39:44 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 182/548] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 00:39:44 2023] PUT /compute/v2.1/servers/f2164441-0fa4-463c-afde-a333095d0e56/os-volume_attachments/e94db36c-926f-4cd4-98fe-89f36eb80bc5 => generated 109 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:39:46 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:46 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:39:46 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:39:46 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:39:46 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:46 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:46 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:46 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:46 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:46 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:46 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Going to try to terminate instance {{(pid=72495) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:39:46 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-2f643ed2-f755-42dd-91b1-d176940df875 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f2164441-0fa4-463c-afde-a333095d0e56" status: 204 len: 0 microversion: 2.1 time: 0.144891 Apr 12 00:39:46 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 181/549] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:39:46 2023] DELETE /compute/v2.1/servers/f2164441-0fa4-463c-afde-a333095d0e56 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:39:46 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-7c804000-2f80-4f5e-a8b0-9d37ed09350f tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:46 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-7c804000-2f80-4f5e-a8b0-9d37ed09350f tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:39:46 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:39:46 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=14 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:39:46 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7c804000-2f80-4f5e-a8b0-9d37ed09350f tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:46 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7c804000-2f80-4f5e-a8b0-9d37ed09350f tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:46 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7c804000-2f80-4f5e-a8b0-9d37ed09350f tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:46 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7c804000-2f80-4f5e-a8b0-9d37ed09350f tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:46 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7c804000-2f80-4f5e-a8b0-9d37ed09350f tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:46 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7c804000-2f80-4f5e-a8b0-9d37ed09350f tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:46 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-7c804000-2f80-4f5e-a8b0-9d37ed09350f tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c276268b63084515a43caa837af30fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c1003f0d1847b7b4c679b0f7cc3110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:39:46 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-7c804000-2f80-4f5e-a8b0-9d37ed09350f tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2164441-0fa4-463c-afde-a333095d0e56" status: 200 len: 1500 microversion: 2.1 time: 0.223000 Apr 12 00:39:46 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 187/550] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:39:46 2023] GET /compute/v2.1/servers/f2164441-0fa4-463c-afde-a333095d0e56 => generated 1500 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:39:47 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-7c8df0f7-6044-40a8-a353-8c1aa48c2d17 req-154fb8f8-f03c-4f0d-9aed-0c8a25f0d6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2164441-0fa4-463c-afde-a333095d0e56", "name": "network-vif-unplugged", "status": "completed", "tag": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:39:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-7c8df0f7-6044-40a8-a353-8c1aa48c2d17 req-154fb8f8-f03c-4f0d-9aed-0c8a25f0d6d8 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-7c8df0f7-6044-40a8-a353-8c1aa48c2d17 req-154fb8f8-f03c-4f0d-9aed-0c8a25f0d6d8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-7c8df0f7-6044-40a8-a353-8c1aa48c2d17 req-154fb8f8-f03c-4f0d-9aed-0c8a25f0d6d8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:47 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-7c8df0f7-6044-40a8-a353-8c1aa48c2d17 req-154fb8f8-f03c-4f0d-9aed-0c8a25f0d6d8 service nova] Creating event network-vif-unplugged:6b36ad5a-353d-438b-95d1-fddbcfe01e2c for instance f2164441-0fa4-463c-afde-a333095d0e56 on user Apr 12 00:39:47 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-7c8df0f7-6044-40a8-a353-8c1aa48c2d17 req-154fb8f8-f03c-4f0d-9aed-0c8a25f0d6d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033103 Apr 12 00:39:47 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 183/551] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:39:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:39:47 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-a8dfed06-e60c-4f81-bace-d854e8e8a8c2 req-2851a925-fad9-4d62-bd21-ea366887519d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2164441-0fa4-463c-afde-a333095d0e56", "name": "network-vif-deleted", "tag": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:39:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a8dfed06-e60c-4f81-bace-d854e8e8a8c2 req-2851a925-fad9-4d62-bd21-ea366887519d service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a8dfed06-e60c-4f81-bace-d854e8e8a8c2 req-2851a925-fad9-4d62-bd21-ea366887519d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a8dfed06-e60c-4f81-bace-d854e8e8a8c2 req-2851a925-fad9-4d62-bd21-ea366887519d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:47 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-a8dfed06-e60c-4f81-bace-d854e8e8a8c2 req-2851a925-fad9-4d62-bd21-ea366887519d service nova] Creating event network-vif-deleted:6b36ad5a-353d-438b-95d1-fddbcfe01e2c for instance f2164441-0fa4-463c-afde-a333095d0e56 on user Apr 12 00:39:47 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-a8dfed06-e60c-4f81-bace-d854e8e8a8c2 req-2851a925-fad9-4d62-bd21-ea366887519d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031641 Apr 12 00:39:47 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 182/552] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:39:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:39:49 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-2d204c57-c527-4918-82b2-d87854f85e56 req-0a16e583-af44-400b-a376-a0752407dae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2164441-0fa4-463c-afde-a333095d0e56", "name": "network-vif-plugged", "status": "completed", "tag": "6b36ad5a-353d-438b-95d1-fddbcfe01e2c"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:39:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2d204c57-c527-4918-82b2-d87854f85e56 req-0a16e583-af44-400b-a376-a0752407dae9 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2d204c57-c527-4918-82b2-d87854f85e56 req-0a16e583-af44-400b-a376-a0752407dae9 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2d204c57-c527-4918-82b2-d87854f85e56 req-0a16e583-af44-400b-a376-a0752407dae9 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:49 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-2d204c57-c527-4918-82b2-d87854f85e56 req-0a16e583-af44-400b-a376-a0752407dae9 service nova] Creating event network-vif-plugged:6b36ad5a-353d-438b-95d1-fddbcfe01e2c for instance f2164441-0fa4-463c-afde-a333095d0e56 on user Apr 12 00:39:49 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-2d204c57-c527-4918-82b2-d87854f85e56 req-0a16e583-af44-400b-a376-a0752407dae9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034759 Apr 12 00:39:49 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 188/553] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:39:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:39:49 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-07ed223f-453b-4544-a4aa-b9128e906d06 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:49 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-07ed223f-453b-4544-a4aa-b9128e906d06 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:39:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-07ed223f-453b-4544-a4aa-b9128e906d06 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-07ed223f-453b-4544-a4aa-b9128e906d06 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-07ed223f-453b-4544-a4aa-b9128e906d06 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-07ed223f-453b-4544-a4aa-b9128e906d06 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-07ed223f-453b-4544-a4aa-b9128e906d06 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-07ed223f-453b-4544-a4aa-b9128e906d06 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:49 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-07ed223f-453b-4544-a4aa-b9128e906d06 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.174138 Apr 12 00:39:49 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 184/554] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:39:49 2023] GET /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a/os-volume_attachments => generated 25 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:39:49 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:49 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:39:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:49 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Going to try to terminate instance {{(pid=72495) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:39:50 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-7d6b3249-d012-49ca-8ad7-7ae12a5b95b3 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a" status: 204 len: 0 microversion: 2.1 time: 0.227247 Apr 12 00:39:50 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 183/555] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:39:49 2023] DELETE /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:39:50 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-cce5beca-031e-4e2b-85dd-fc43dcd4413e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:39:50 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-cce5beca-031e-4e2b-85dd-fc43dcd4413e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:39:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-cce5beca-031e-4e2b-85dd-fc43dcd4413e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-cce5beca-031e-4e2b-85dd-fc43dcd4413e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-cce5beca-031e-4e2b-85dd-fc43dcd4413e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-cce5beca-031e-4e2b-85dd-fc43dcd4413e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-cce5beca-031e-4e2b-85dd-fc43dcd4413e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-cce5beca-031e-4e2b-85dd-fc43dcd4413e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:50 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-cce5beca-031e-4e2b-85dd-fc43dcd4413e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373f582479c441e8ce9849ca694a186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f3c567dc84773a33d596920df727a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:39:50 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-cce5beca-031e-4e2b-85dd-fc43dcd4413e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a" status: 200 len: 1670 microversion: 2.1 time: 0.172588 Apr 12 00:39:50 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 189/556] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:39:50 2023] GET /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:39:50 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-6ae0888b-0944-467e-8d35-50996a69d1c0 req-3b18f468-7bf2-4750-b16b-80b5df599be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bae2f38-fd5e-4d51-be63-22bbf54cd77a", "name": "network-vif-unplugged", "status": "completed", "tag": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:39:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-6ae0888b-0944-467e-8d35-50996a69d1c0 req-3b18f468-7bf2-4750-b16b-80b5df599be8 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-6ae0888b-0944-467e-8d35-50996a69d1c0 req-3b18f468-7bf2-4750-b16b-80b5df599be8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-6ae0888b-0944-467e-8d35-50996a69d1c0 req-3b18f468-7bf2-4750-b16b-80b5df599be8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:50 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-6ae0888b-0944-467e-8d35-50996a69d1c0 req-3b18f468-7bf2-4750-b16b-80b5df599be8 service nova] Creating event network-vif-unplugged:a152413c-fa33-4f4e-8c91-2b8a8c5565b6 for instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a on user Apr 12 00:39:50 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-6ae0888b-0944-467e-8d35-50996a69d1c0 req-3b18f468-7bf2-4750-b16b-80b5df599be8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033462 Apr 12 00:39:50 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 185/557] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:39:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:39:51 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-3ce85d38-2077-4747-a289-271f059b10b9 req-3ccfece2-1bf5-440e-8235-e900c1921c98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bae2f38-fd5e-4d51-be63-22bbf54cd77a", "name": "network-vif-deleted", "tag": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:39:51 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3ce85d38-2077-4747-a289-271f059b10b9 req-3ccfece2-1bf5-440e-8235-e900c1921c98 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:51 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3ce85d38-2077-4747-a289-271f059b10b9 req-3ccfece2-1bf5-440e-8235-e900c1921c98 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:51 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3ce85d38-2077-4747-a289-271f059b10b9 req-3ccfece2-1bf5-440e-8235-e900c1921c98 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:51 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-3ce85d38-2077-4747-a289-271f059b10b9 req-3ccfece2-1bf5-440e-8235-e900c1921c98 service nova] Creating event network-vif-deleted:a152413c-fa33-4f4e-8c91-2b8a8c5565b6 for instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a on user Apr 12 00:39:51 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-3ce85d38-2077-4747-a289-271f059b10b9 req-3ccfece2-1bf5-440e-8235-e900c1921c98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041801 Apr 12 00:39:51 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 184/558] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:39:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:39:52 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-93477f6a-bada-4542-a354-7cabe074141b req-ebcf49d8-2bde-4ba9-9073-27c5572d41e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bae2f38-fd5e-4d51-be63-22bbf54cd77a", "name": "network-vif-plugged", "status": "completed", "tag": "a152413c-fa33-4f4e-8c91-2b8a8c5565b6"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:39:52 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-93477f6a-bada-4542-a354-7cabe074141b req-ebcf49d8-2bde-4ba9-9073-27c5572d41e2 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:39:52 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-93477f6a-bada-4542-a354-7cabe074141b req-ebcf49d8-2bde-4ba9-9073-27c5572d41e2 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:39:52 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-93477f6a-bada-4542-a354-7cabe074141b req-ebcf49d8-2bde-4ba9-9073-27c5572d41e2 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:39:52 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-93477f6a-bada-4542-a354-7cabe074141b req-ebcf49d8-2bde-4ba9-9073-27c5572d41e2 service nova] Creating event network-vif-plugged:a152413c-fa33-4f4e-8c91-2b8a8c5565b6 for instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a on user Apr 12 00:39:52 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-93477f6a-bada-4542-a354-7cabe074141b req-ebcf49d8-2bde-4ba9-9073-27c5572d41e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029193 Apr 12 00:39:52 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 190/559] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:39:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:09 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=8 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:40:09 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=14 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:40:09 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-1c029869-db12-45b9-aed3-2e6125cf7c75 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:09 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-1c029869-db12-45b9-aed3-2e6125cf7c75 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:40:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1c029869-db12-45b9-aed3-2e6125cf7c75 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1c029869-db12-45b9-aed3-2e6125cf7c75 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1c029869-db12-45b9-aed3-2e6125cf7c75 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1c029869-db12-45b9-aed3-2e6125cf7c75 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1c029869-db12-45b9-aed3-2e6125cf7c75 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1c029869-db12-45b9-aed3-2e6125cf7c75 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:09 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-1c029869-db12-45b9-aed3-2e6125cf7c75 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.113525 Apr 12 00:40:09 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 186/560] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 00:40:09 2023] GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d/os-interface => generated 283 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:10 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:40:10 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:40:10 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=8 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:40:10 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=16 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:40:10 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41a82ec2-4e13-4a4b-980f-66064c4ec035"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:10 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:40:10 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:10 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:10 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:10 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:10 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:10 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:10 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-1459661d-0531-4dd7-85de-050f7a80d26a req-c955f0b5-08e1-4b8a-be4c-97fda0cba0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49c8e8b7-1f91-4cf5-a222-c787a186444d", "tag": "a2a25522-be49-4ac7-9893-d030dc2d87ab"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:10 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-1459661d-0531-4dd7-85de-050f7a80d26a req-c955f0b5-08e1-4b8a-be4c-97fda0cba0e8 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:10 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-1459661d-0531-4dd7-85de-050f7a80d26a req-c955f0b5-08e1-4b8a-be4c-97fda0cba0e8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:10 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-1459661d-0531-4dd7-85de-050f7a80d26a req-c955f0b5-08e1-4b8a-be4c-97fda0cba0e8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:10 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-1459661d-0531-4dd7-85de-050f7a80d26a req-c955f0b5-08e1-4b8a-be4c-97fda0cba0e8 service nova] Creating event network-changed:a2a25522-be49-4ac7-9893-d030dc2d87ab for instance 49c8e8b7-1f91-4cf5-a222-c787a186444d on user Apr 12 00:40:10 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-1459661d-0531-4dd7-85de-050f7a80d26a req-c955f0b5-08e1-4b8a-be4c-97fda0cba0e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164661 Apr 12 00:40:10 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 185/561] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:40:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:10 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-44d99bde-db2d-47b1-ba90-5ba34218bdf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "POST /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305540 Apr 12 00:40:10 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 191/562] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 00:40:10 2023] POST /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:13 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-41b466a6-a2e5-495b-a120-7e6c791c04d0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:13 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-41b466a6-a2e5-495b-a120-7e6c791c04d0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:40:13 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-41b466a6-a2e5-495b-a120-7e6c791c04d0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:13 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-41b466a6-a2e5-495b-a120-7e6c791c04d0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:13 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-41b466a6-a2e5-495b-a120-7e6c791c04d0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:13 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-41b466a6-a2e5-495b-a120-7e6c791c04d0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:13 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-41b466a6-a2e5-495b-a120-7e6c791c04d0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:13 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-41b466a6-a2e5-495b-a120-7e6c791c04d0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:14 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-41b466a6-a2e5-495b-a120-7e6c791c04d0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:40:14 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-41b466a6-a2e5-495b-a120-7e6c791c04d0 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ecfc9ba1-d560-410d-af55-8d5e578aa00d" status: 200 len: 1442 microversion: 2.1 time: 0.152330 Apr 12 00:40:14 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 187/563] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:40:13 2023] GET /compute/v2.1/servers/ecfc9ba1-d560-410d-af55-8d5e578aa00d => generated 1442 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:14 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-2b950318-19b7-4d34-bfc1-9076e4240cf9 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:14 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-2b950318-19b7-4d34-bfc1-9076e4240cf9 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] [instance: daa798af-8437-4083-b73c-92b0cb39d861] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:40:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2b950318-19b7-4d34-bfc1-9076e4240cf9 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2b950318-19b7-4d34-bfc1-9076e4240cf9 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2b950318-19b7-4d34-bfc1-9076e4240cf9 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2b950318-19b7-4d34-bfc1-9076e4240cf9 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2b950318-19b7-4d34-bfc1-9076e4240cf9 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2b950318-19b7-4d34-bfc1-9076e4240cf9 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:14 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-2b950318-19b7-4d34-bfc1-9076e4240cf9 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] HTTP exception thrown: Instance daa798af-8437-4083-b73c-92b0cb39d861 could not be found. Apr 12 00:40:14 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-2b950318-19b7-4d34-bfc1-9076e4240cf9 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Request method failure captured: Apr 12 00:40:14 user devstack@n-api.service[72495]: request: GET /compute/v2.1/servers/daa798af-8437-4083-b73c-92b0cb39d861 HTTP/1.1 Apr 12 00:40:14 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:40:14 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:40:14 user devstack@n-api.service[72495]: Connection: close Apr 12 00:40:14 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 00:40:14 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:40:14 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:40:14 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:40:14 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:40:14 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNf1L3OD6lrVVzJwULYNwycxuFhnIAn37awSM6WR_wKUNug5H6m8ATy3cqNAe1zMGt9AdiD8YIRAHOYb2SoNvN8GauTSuOtv8-JqEsb2uKS3t3Tj_lLEQ-xQ7p-sdlHRV0bZSvE11q_vWz1qXNkfNsbFT7FYXNZPNq_mPh5k_WACt2_o Apr 12 00:40:14 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:40:14 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:40:14 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:40:14 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:40:14 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:40:14 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:40:14 user devstack@n-api.service[72495]: X-Project-Id: 4d6cebaed9654692bd9aef950a08741b Apr 12 00:40:14 user devstack@n-api.service[72495]: X-Project-Name: tempest-VolumesNegativeTest-791919853 Apr 12 00:40:14 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:40:14 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:40:14 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4d6cebaed9654692bd9aef950a08741b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4d6cebaed9654692bd9aef950a08741b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4d6cebaed9654692bd9aef950a08741b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:40:14 user devstack@n-api.service[72495]: X-Tenant: tempest-VolumesNegativeTest-791919853 Apr 12 00:40:14 user devstack@n-api.service[72495]: X-Tenant-Id: 4d6cebaed9654692bd9aef950a08741b Apr 12 00:40:14 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-VolumesNegativeTest-791919853 Apr 12 00:40:14 user devstack@n-api.service[72495]: X-User: tempest-VolumesNegativeTest-791919853-project-member Apr 12 00:40:14 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:40:14 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:40:14 user devstack@n-api.service[72495]: X-User-Id: 7724cf4de81c4147929f43fd8744e8f9 Apr 12 00:40:14 user devstack@n-api.service[72495]: X-User-Name: tempest-VolumesNegativeTest-791919853-project-member Apr 12 00:40:14 user devstack@n-api.service[72495]: method: > Apr 12 00:40:14 user devstack@n-api.service[72495]: exception: Instance daa798af-8437-4083-b73c-92b0cb39d861 could not be found. Apr 12 00:40:14 user devstack@n-api.service[72495]: action_args: {'id': 'daa798af-8437-4083-b73c-92b0cb39d861'} Apr 12 00:40:14 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daa798af-8437-4083-b73c-92b0cb39d861 could not be found. Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daa798af-8437-4083-b73c-92b0cb39d861 could not be found. Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daa798af-8437-4083-b73c-92b0cb39d861 could not be found. Apr 12 00:40:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:40:14 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-2b950318-19b7-4d34-bfc1-9076e4240cf9 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] Returning 404 to user: Instance daa798af-8437-4083-b73c-92b0cb39d861 could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:40:14 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-2b950318-19b7-4d34-bfc1-9076e4240cf9 tempest-VolumesNegativeTest-791919853 tempest-VolumesNegativeTest-791919853-project-member] 10.0.0.210 "GET /compute/v2.1/servers/daa798af-8437-4083-b73c-92b0cb39d861" status: 404 len: 111 microversion: 2.1 time: 0.031889 Apr 12 00:40:14 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 186/564] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:40:14 2023] GET /compute/v2.1/servers/daa798af-8437-4083-b73c-92b0cb39d861 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:40:17 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:17 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:40:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:18 user devstack@n-api.service[72496]: DEBUG nova.objects.instance [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'flavor' on Instance uuid 49c8e8b7-1f91-4cf5-a222-c787a186444d {{(pid=72496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:40:18 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-fa483411-602b-48b6-ba7e-375c0bcd0ae2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "POST /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d/action" status: 200 len: 32 microversion: 2.1 time: 0.156634 Apr 12 00:40:18 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 192/565] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 00:40:17 2023] POST /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:40:18 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-0981f0b5-e8db-4332-955e-176d4c766cf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:18 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-0981f0b5-e8db-4332-955e-176d4c766cf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:40:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0981f0b5-e8db-4332-955e-176d4c766cf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0981f0b5-e8db-4332-955e-176d4c766cf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0981f0b5-e8db-4332-955e-176d4c766cf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0981f0b5-e8db-4332-955e-176d4c766cf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0981f0b5-e8db-4332-955e-176d4c766cf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0981f0b5-e8db-4332-955e-176d4c766cf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:18 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-0981f0b5-e8db-4332-955e-176d4c766cf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9421443b2f421298a934122c6a8b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf1fea74ef143e6b394e41e7c4ed495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:40:18 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-0981f0b5-e8db-4332-955e-176d4c766cf6 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d" status: 200 len: 1723 microversion: 2.1 time: 0.150364 Apr 12 00:40:18 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 188/566] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:40:18 2023] GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:18 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-7a928a33-5477-4275-a452-eb82d9684c9d req-f1ef95e6-1a6a-472c-adc3-9a27104bd258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c8e8b7-1f91-4cf5-a222-c787a186444d", "name": "network-vif-unplugged", "status": "completed", "tag": "a2a25522-be49-4ac7-9893-d030dc2d87ab"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-7a928a33-5477-4275-a452-eb82d9684c9d req-f1ef95e6-1a6a-472c-adc3-9a27104bd258 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-7a928a33-5477-4275-a452-eb82d9684c9d req-f1ef95e6-1a6a-472c-adc3-9a27104bd258 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-7a928a33-5477-4275-a452-eb82d9684c9d req-f1ef95e6-1a6a-472c-adc3-9a27104bd258 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:19 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-7a928a33-5477-4275-a452-eb82d9684c9d req-f1ef95e6-1a6a-472c-adc3-9a27104bd258 service nova] Creating event network-vif-unplugged:a2a25522-be49-4ac7-9893-d030dc2d87ab for instance 49c8e8b7-1f91-4cf5-a222-c787a186444d on user Apr 12 00:40:19 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-7a928a33-5477-4275-a452-eb82d9684c9d req-f1ef95e6-1a6a-472c-adc3-9a27104bd258 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032813 Apr 12 00:40:19 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 187/567] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:40:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:20 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-a3680d6c-a822-4750-a20f-fa26ab4afad7 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:20 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-a3680d6c-a822-4750-a20f-fa26ab4afad7 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:40:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a3680d6c-a822-4750-a20f-fa26ab4afad7 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a3680d6c-a822-4750-a20f-fa26ab4afad7 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a3680d6c-a822-4750-a20f-fa26ab4afad7 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a3680d6c-a822-4750-a20f-fa26ab4afad7 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a3680d6c-a822-4750-a20f-fa26ab4afad7 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:20 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a3680d6c-a822-4750-a20f-fa26ab4afad7 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:21 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-e1aad3d2-0373-455e-8f56-fb279d4e1a68 req-75953de1-6a76-46c6-a031-0bb27427eea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c8e8b7-1f91-4cf5-a222-c787a186444d", "name": "network-vif-plugged", "status": "completed", "tag": "a2a25522-be49-4ac7-9893-d030dc2d87ab"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:21 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-a3680d6c-a822-4750-a20f-fa26ab4afad7 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1277a40a-6389-4d88-bbc6-bda27d465c35/action" status: 202 len: 0 microversion: 2.87 time: 0.080975 Apr 12 00:40:21 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 193/568] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 00:40:20 2023] POST /compute/v2.1/servers/1277a40a-6389-4d88-bbc6-bda27d465c35/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:40:21 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-e1aad3d2-0373-455e-8f56-fb279d4e1a68 req-75953de1-6a76-46c6-a031-0bb27427eea0 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:21 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-e1aad3d2-0373-455e-8f56-fb279d4e1a68 req-75953de1-6a76-46c6-a031-0bb27427eea0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:21 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-e1aad3d2-0373-455e-8f56-fb279d4e1a68 req-75953de1-6a76-46c6-a031-0bb27427eea0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:21 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-e0f3c390-0c0e-45c3-aa38-cc3a8147ad6c tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:21 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-e0f3c390-0c0e-45c3-aa38-cc3a8147ad6c tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:40:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e0f3c390-0c0e-45c3-aa38-cc3a8147ad6c tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e0f3c390-0c0e-45c3-aa38-cc3a8147ad6c tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e0f3c390-0c0e-45c3-aa38-cc3a8147ad6c tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e0f3c390-0c0e-45c3-aa38-cc3a8147ad6c tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e0f3c390-0c0e-45c3-aa38-cc3a8147ad6c tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e0f3c390-0c0e-45c3-aa38-cc3a8147ad6c tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:21 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-e1aad3d2-0373-455e-8f56-fb279d4e1a68 req-75953de1-6a76-46c6-a031-0bb27427eea0 service nova] Creating event network-vif-plugged:a2a25522-be49-4ac7-9893-d030dc2d87ab for instance 49c8e8b7-1f91-4cf5-a222-c787a186444d on user Apr 12 00:40:21 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-e1aad3d2-0373-455e-8f56-fb279d4e1a68 req-75953de1-6a76-46c6-a031-0bb27427eea0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043169 Apr 12 00:40:21 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 189/569] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:40:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:21 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-e0f3c390-0c0e-45c3-aa38-cc3a8147ad6c tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:40:21 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-e0f3c390-0c0e-45c3-aa38-cc3a8147ad6c tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:40:21 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-e0f3c390-0c0e-45c3-aa38-cc3a8147ad6c tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:40:21 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-e0f3c390-0c0e-45c3-aa38-cc3a8147ad6c tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1277a40a-6389-4d88-bbc6-bda27d465c35" status: 200 len: 1762 microversion: 2.87 time: 0.381042 Apr 12 00:40:21 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 188/570] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:40:21 2023] GET /compute/v2.1/servers/1277a40a-6389-4d88-bbc6-bda27d465c35 => generated 1762 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:40:22 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-4393dd48-ed66-40a1-990a-76222e201e44 req-3ea497b2-dd24-4914-be97-428aefcbe421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1277a40a-6389-4d88-bbc6-bda27d465c35", "name": "network-vif-unplugged", "status": "completed", "tag": "8e32719d-1d2e-439a-9dba-9ac82140fbac"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4393dd48-ed66-40a1-990a-76222e201e44 req-3ea497b2-dd24-4914-be97-428aefcbe421 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4393dd48-ed66-40a1-990a-76222e201e44 req-3ea497b2-dd24-4914-be97-428aefcbe421 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4393dd48-ed66-40a1-990a-76222e201e44 req-3ea497b2-dd24-4914-be97-428aefcbe421 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:22 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-4393dd48-ed66-40a1-990a-76222e201e44 req-3ea497b2-dd24-4914-be97-428aefcbe421 service nova] Creating event network-vif-unplugged:8e32719d-1d2e-439a-9dba-9ac82140fbac for instance 1277a40a-6389-4d88-bbc6-bda27d465c35 on user Apr 12 00:40:22 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-4393dd48-ed66-40a1-990a-76222e201e44 req-3ea497b2-dd24-4914-be97-428aefcbe421 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.159610 Apr 12 00:40:22 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 194/571] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:40:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:23 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-ef6f1317-fb7f-4078-a54c-70d989dbe3cc req-ac2d4d03-53aa-444c-9eba-c40099c3766b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c8e8b7-1f91-4cf5-a222-c787a186444d", "name": "network-vif-plugged", "status": "completed", "tag": "a2a25522-be49-4ac7-9893-d030dc2d87ab"}, {"server_uuid": "49c8e8b7-1f91-4cf5-a222-c787a186444d", "name": "network-vif-plugged", "status": "completed", "tag": "a2a25522-be49-4ac7-9893-d030dc2d87ab"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-ef6f1317-fb7f-4078-a54c-70d989dbe3cc req-ac2d4d03-53aa-444c-9eba-c40099c3766b service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-ef6f1317-fb7f-4078-a54c-70d989dbe3cc req-ac2d4d03-53aa-444c-9eba-c40099c3766b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-ef6f1317-fb7f-4078-a54c-70d989dbe3cc req-ac2d4d03-53aa-444c-9eba-c40099c3766b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:23 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-ef6f1317-fb7f-4078-a54c-70d989dbe3cc req-ac2d4d03-53aa-444c-9eba-c40099c3766b service nova] Creating event network-vif-plugged:a2a25522-be49-4ac7-9893-d030dc2d87ab for instance 49c8e8b7-1f91-4cf5-a222-c787a186444d on user Apr 12 00:40:23 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-ef6f1317-fb7f-4078-a54c-70d989dbe3cc req-ac2d4d03-53aa-444c-9eba-c40099c3766b service nova] Creating event network-vif-plugged:a2a25522-be49-4ac7-9893-d030dc2d87ab for instance 49c8e8b7-1f91-4cf5-a222-c787a186444d on user Apr 12 00:40:23 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-ef6f1317-fb7f-4078-a54c-70d989dbe3cc req-ac2d4d03-53aa-444c-9eba-c40099c3766b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034171 Apr 12 00:40:23 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 190/572] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:40:23 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:24 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-ac3ec833-9ee9-47e6-b243-13fe2e8c16cf req-1bee4af8-6e8b-43db-a793-354e68512e55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1277a40a-6389-4d88-bbc6-bda27d465c35", "name": "network-vif-plugged", "status": "completed", "tag": "8e32719d-1d2e-439a-9dba-9ac82140fbac"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-ac3ec833-9ee9-47e6-b243-13fe2e8c16cf req-1bee4af8-6e8b-43db-a793-354e68512e55 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-ac3ec833-9ee9-47e6-b243-13fe2e8c16cf req-1bee4af8-6e8b-43db-a793-354e68512e55 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-ac3ec833-9ee9-47e6-b243-13fe2e8c16cf req-1bee4af8-6e8b-43db-a793-354e68512e55 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:24 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-ac3ec833-9ee9-47e6-b243-13fe2e8c16cf req-1bee4af8-6e8b-43db-a793-354e68512e55 service nova] Creating event network-vif-plugged:8e32719d-1d2e-439a-9dba-9ac82140fbac for instance 1277a40a-6389-4d88-bbc6-bda27d465c35 on user Apr 12 00:40:24 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-ac3ec833-9ee9-47e6-b243-13fe2e8c16cf req-1bee4af8-6e8b-43db-a793-354e68512e55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039236 Apr 12 00:40:24 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 189/573] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:40:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:26 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-fbcc8a16-5e41-4aaa-acd9-b4feb5cf3874 req-ff08719b-0921-4cc6-bae4-ebe2e1278697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1277a40a-6389-4d88-bbc6-bda27d465c35", "name": "network-vif-plugged", "status": "completed", "tag": "8e32719d-1d2e-439a-9dba-9ac82140fbac"}, {"server_uuid": "1277a40a-6389-4d88-bbc6-bda27d465c35", "name": "network-vif-plugged", "status": "completed", "tag": "8e32719d-1d2e-439a-9dba-9ac82140fbac"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:26 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-fbcc8a16-5e41-4aaa-acd9-b4feb5cf3874 req-ff08719b-0921-4cc6-bae4-ebe2e1278697 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:26 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-fbcc8a16-5e41-4aaa-acd9-b4feb5cf3874 req-ff08719b-0921-4cc6-bae4-ebe2e1278697 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:26 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-fbcc8a16-5e41-4aaa-acd9-b4feb5cf3874 req-ff08719b-0921-4cc6-bae4-ebe2e1278697 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:26 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-fbcc8a16-5e41-4aaa-acd9-b4feb5cf3874 req-ff08719b-0921-4cc6-bae4-ebe2e1278697 service nova] Creating event network-vif-plugged:8e32719d-1d2e-439a-9dba-9ac82140fbac for instance 1277a40a-6389-4d88-bbc6-bda27d465c35 on user Apr 12 00:40:26 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-fbcc8a16-5e41-4aaa-acd9-b4feb5cf3874 req-ff08719b-0921-4cc6-bae4-ebe2e1278697 service nova] Creating event network-vif-plugged:8e32719d-1d2e-439a-9dba-9ac82140fbac for instance 1277a40a-6389-4d88-bbc6-bda27d465c35 on user Apr 12 00:40:26 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-fbcc8a16-5e41-4aaa-acd9-b4feb5cf3874 req-ff08719b-0921-4cc6-bae4-ebe2e1278697 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038591 Apr 12 00:40:26 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 195/574] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:40:26 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:36 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=10 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:40:36 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=20 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:40:36 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:36 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:40:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:36 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-61491d24-467c-44e3-bac4-46829722e256 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/action" status: 202 len: 0 microversion: 2.1 time: 0.181199 Apr 12 00:40:36 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 191/575] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 00:40:36 2023] POST /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:40:36 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-8973e69f-6dc7-4c66-a53e-8000bccccd5a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:36 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-8973e69f-6dc7-4c66-a53e-8000bccccd5a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:40:36 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=12 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:40:36 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=14 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:40:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8973e69f-6dc7-4c66-a53e-8000bccccd5a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8973e69f-6dc7-4c66-a53e-8000bccccd5a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8973e69f-6dc7-4c66-a53e-8000bccccd5a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8973e69f-6dc7-4c66-a53e-8000bccccd5a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8973e69f-6dc7-4c66-a53e-8000bccccd5a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8973e69f-6dc7-4c66-a53e-8000bccccd5a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:36 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-8973e69f-6dc7-4c66-a53e-8000bccccd5a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:40:36 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-8973e69f-6dc7-4c66-a53e-8000bccccd5a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 200 len: 1729 microversion: 2.1 time: 0.235068 Apr 12 00:40:36 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 190/576] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:40:36 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 1729 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:37 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=10 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:40:37 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:40:37 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-8b5688c5-ef5f-4828-b5a8-7ae5367b8f93 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:37 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-8b5688c5-ef5f-4828-b5a8-7ae5367b8f93 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: f2164441-0fa4-463c-afde-a333095d0e56] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:40:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8b5688c5-ef5f-4828-b5a8-7ae5367b8f93 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8b5688c5-ef5f-4828-b5a8-7ae5367b8f93 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8b5688c5-ef5f-4828-b5a8-7ae5367b8f93 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8b5688c5-ef5f-4828-b5a8-7ae5367b8f93 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8b5688c5-ef5f-4828-b5a8-7ae5367b8f93 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8b5688c5-ef5f-4828-b5a8-7ae5367b8f93 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:37 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-8b5688c5-ef5f-4828-b5a8-7ae5367b8f93 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] HTTP exception thrown: Instance f2164441-0fa4-463c-afde-a333095d0e56 could not be found. Apr 12 00:40:37 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-8b5688c5-ef5f-4828-b5a8-7ae5367b8f93 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Request method failure captured: Apr 12 00:40:37 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/f2164441-0fa4-463c-afde-a333095d0e56 HTTP/1.1 Apr 12 00:40:37 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:40:37 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:40:37 user devstack@n-api.service[72496]: Connection: close Apr 12 00:40:37 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:40:37 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:40:37 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:40:37 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:40:37 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:40:37 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNfyr91gvqMcsaXhrtbVzq7_ojUHwoHryhp7hXJvBLoo83DG-0pnXUpdKNwAknAiiO4FAgAA_PmenTqvCUT90FtLSJPGun8zpmlwMQ7AxNvA1jE1OMlAY_cRJkmx3FdD0hpHsnBEvJEmqzOF6ETlWs9W8Zef7R_e51zNh-sly678jh_0 Apr 12 00:40:37 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:40:37 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:40:37 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:40:37 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:40:37 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:40:37 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:40:37 user devstack@n-api.service[72496]: X-Project-Id: a8c1003f0d1847b7b4c679b0f7cc3110 Apr 12 00:40:37 user devstack@n-api.service[72496]: X-Project-Name: tempest-VolumesAdminNegativeTest-1593136751 Apr 12 00:40:37 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:40:37 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:40:37 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8c1003f0d1847b7b4c679b0f7cc3110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a8c1003f0d1847b7b4c679b0f7cc3110"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8c1003f0d1847b7b4c679b0f7cc3110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:40:37 user devstack@n-api.service[72496]: X-Tenant: tempest-VolumesAdminNegativeTest-1593136751 Apr 12 00:40:37 user devstack@n-api.service[72496]: X-Tenant-Id: a8c1003f0d1847b7b4c679b0f7cc3110 Apr 12 00:40:37 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1593136751 Apr 12 00:40:37 user devstack@n-api.service[72496]: X-User: tempest-VolumesAdminNegativeTest-1593136751-project-member Apr 12 00:40:37 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:40:37 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:40:37 user devstack@n-api.service[72496]: X-User-Id: c276268b63084515a43caa837af30fb1 Apr 12 00:40:37 user devstack@n-api.service[72496]: X-User-Name: tempest-VolumesAdminNegativeTest-1593136751-project-member Apr 12 00:40:37 user devstack@n-api.service[72496]: method: > Apr 12 00:40:37 user devstack@n-api.service[72496]: exception: Instance f2164441-0fa4-463c-afde-a333095d0e56 could not be found. Apr 12 00:40:37 user devstack@n-api.service[72496]: action_args: {'id': 'f2164441-0fa4-463c-afde-a333095d0e56'} Apr 12 00:40:37 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2164441-0fa4-463c-afde-a333095d0e56 could not be found. Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2164441-0fa4-463c-afde-a333095d0e56 could not be found. Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2164441-0fa4-463c-afde-a333095d0e56 could not be found. Apr 12 00:40:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:40:37 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-8b5688c5-ef5f-4828-b5a8-7ae5367b8f93 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Returning 404 to user: Instance f2164441-0fa4-463c-afde-a333095d0e56 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:40:37 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-8b5688c5-ef5f-4828-b5a8-7ae5367b8f93 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2164441-0fa4-463c-afde-a333095d0e56" status: 404 len: 111 microversion: 2.1 time: 0.310886 Apr 12 00:40:37 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 196/577] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:40:37 2023] GET /compute/v2.1/servers/f2164441-0fa4-463c-afde-a333095d0e56 => generated 111 bytes in 312 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:40:37 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-290889f7-a69e-4abe-8448-3cf26e3fdcf2 req-1bdad33f-76c8-44f2-b11e-878642d3da15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe6d6bc-65a6-469a-89a0-7e4c51620b14", "name": "network-vif-unplugged", "status": "completed", "tag": "b99b54c2-0b21-42ea-91d0-087aa230da7e"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-290889f7-a69e-4abe-8448-3cf26e3fdcf2 req-1bdad33f-76c8-44f2-b11e-878642d3da15 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-290889f7-a69e-4abe-8448-3cf26e3fdcf2 req-1bdad33f-76c8-44f2-b11e-878642d3da15 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-290889f7-a69e-4abe-8448-3cf26e3fdcf2 req-1bdad33f-76c8-44f2-b11e-878642d3da15 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:37 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-290889f7-a69e-4abe-8448-3cf26e3fdcf2 req-1bdad33f-76c8-44f2-b11e-878642d3da15 service nova] Creating event network-vif-unplugged:b99b54c2-0b21-42ea-91d0-087aa230da7e for instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 on user Apr 12 00:40:37 user devstack@n-api.service[72494]: DEBUG nova.compute.api [req-290889f7-a69e-4abe-8448-3cf26e3fdcf2 req-1bdad33f-76c8-44f2-b11e-878642d3da15 service nova] Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 00:40:37 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-290889f7-a69e-4abe-8448-3cf26e3fdcf2 req-1bdad33f-76c8-44f2-b11e-878642d3da15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044161 Apr 12 00:40:37 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 192/578] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:40:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:39 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-a72747d1-229c-4371-b53a-10baa130d031 req-24e9d956-b290-4698-9281-efc05d4ced00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe6d6bc-65a6-469a-89a0-7e4c51620b14", "name": "network-vif-plugged", "status": "completed", "tag": "b99b54c2-0b21-42ea-91d0-087aa230da7e"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a72747d1-229c-4371-b53a-10baa130d031 req-24e9d956-b290-4698-9281-efc05d4ced00 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a72747d1-229c-4371-b53a-10baa130d031 req-24e9d956-b290-4698-9281-efc05d4ced00 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a72747d1-229c-4371-b53a-10baa130d031 req-24e9d956-b290-4698-9281-efc05d4ced00 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:39 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:39 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:40:39 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-a72747d1-229c-4371-b53a-10baa130d031 req-24e9d956-b290-4698-9281-efc05d4ced00 service nova] Creating event network-vif-plugged:b99b54c2-0b21-42ea-91d0-087aa230da7e for instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 on user Apr 12 00:40:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:39 user devstack@n-api.service[72495]: DEBUG nova.compute.api [req-a72747d1-229c-4371-b53a-10baa130d031 req-24e9d956-b290-4698-9281-efc05d4ced00 service nova] Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72495) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 00:40:39 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-a72747d1-229c-4371-b53a-10baa130d031 req-24e9d956-b290-4698-9281-efc05d4ced00 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040266 Apr 12 00:40:39 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 191/579] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:40:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:39 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Going to try to terminate instance {{(pid=72496) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:40:39 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-1b2e5f19-68db-419b-8338-04bee5b64817 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" status: 204 len: 0 microversion: 2.1 time: 0.121152 Apr 12 00:40:39 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 197/580] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:40:39 2023] DELETE /compute/v2.1/servers/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:40:39 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-2f3e3898-3b53-4f4c-bfb1-a1c172319084 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:39 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-2f3e3898-3b53-4f4c-bfb1-a1c172319084 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:40:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2f3e3898-3b53-4f4c-bfb1-a1c172319084 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2f3e3898-3b53-4f4c-bfb1-a1c172319084 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2f3e3898-3b53-4f4c-bfb1-a1c172319084 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2f3e3898-3b53-4f4c-bfb1-a1c172319084 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2f3e3898-3b53-4f4c-bfb1-a1c172319084 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2f3e3898-3b53-4f4c-bfb1-a1c172319084 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:39 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-2f3e3898-3b53-4f4c-bfb1-a1c172319084 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c276268b63084515a43caa837af30fb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c1003f0d1847b7b4c679b0f7cc3110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:40:39 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-2f3e3898-3b53-4f4c-bfb1-a1c172319084 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" status: 200 len: 1668 microversion: 2.1 time: 0.179877 Apr 12 00:40:39 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 193/581] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:40:39 2023] GET /compute/v2.1/servers/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 => generated 1668 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:40 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-474681af-bafe-444f-9d5f-844235a5aca5 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:40 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-474681af-bafe-444f-9d5f-844235a5aca5 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:40:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-474681af-bafe-444f-9d5f-844235a5aca5 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-474681af-bafe-444f-9d5f-844235a5aca5 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-474681af-bafe-444f-9d5f-844235a5aca5 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-474681af-bafe-444f-9d5f-844235a5aca5 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-474681af-bafe-444f-9d5f-844235a5aca5 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-474681af-bafe-444f-9d5f-844235a5aca5 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:40 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-474681af-bafe-444f-9d5f-844235a5aca5 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] HTTP exception thrown: Instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a could not be found. Apr 12 00:40:40 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-474681af-bafe-444f-9d5f-844235a5aca5 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Request method failure captured: Apr 12 00:40:40 user devstack@n-api.service[72495]: request: GET /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a HTTP/1.1 Apr 12 00:40:40 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:40:40 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:40:40 user devstack@n-api.service[72495]: Connection: close Apr 12 00:40:40 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 00:40:40 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:40:40 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:40:40 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:40:40 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:40:40 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNfx-yPB8Addd9whxbTRQOdN90sGir-xfc1IiR7-ECw56svld7JonHx7axp9WUmnT4KzR5TFzU-_uCRK58QPK_z1_aUm3UKF-xkJbrjTzJI02gd86EhzUOHFXsNSRIvLDd7tPEw_YsNig7FJnlwWFmOoZQqpImrudgWYdjbdfFy26et4 Apr 12 00:40:40 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:40:40 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:40:40 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:40:40 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:40:40 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:40:40 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:40:40 user devstack@n-api.service[72495]: X-Project-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:40:40 user devstack@n-api.service[72495]: X-Project-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:40:40 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:40:40 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:40:40 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b56f3c567dc84773a33d596920df727a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:40:40 user devstack@n-api.service[72495]: X-Tenant: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:40:40 user devstack@n-api.service[72495]: X-Tenant-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:40:40 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:40:40 user devstack@n-api.service[72495]: X-User: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:40:40 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:40:40 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:40:40 user devstack@n-api.service[72495]: X-User-Id: d373f582479c441e8ce9849ca694a186 Apr 12 00:40:40 user devstack@n-api.service[72495]: X-User-Name: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:40:40 user devstack@n-api.service[72495]: method: > Apr 12 00:40:40 user devstack@n-api.service[72495]: exception: Instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a could not be found. Apr 12 00:40:40 user devstack@n-api.service[72495]: action_args: {'id': '2bae2f38-fd5e-4d51-be63-22bbf54cd77a'} Apr 12 00:40:40 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a could not be found. Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a could not be found. Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a could not be found. Apr 12 00:40:40 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:40:40 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-474681af-bafe-444f-9d5f-844235a5aca5 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Returning 404 to user: Instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:40:40 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-474681af-bafe-444f-9d5f-844235a5aca5 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a" status: 404 len: 111 microversion: 2.1 time: 0.035628 Apr 12 00:40:40 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 192/582] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:40:40 2023] GET /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:40:40 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-edd4861d-98be-402f-b928-65054867d21f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '.version_select at 0x7f7cd4521f30>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:40 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-edd4861d-98be-402f-b928-65054867d21f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1703783656" status: 202 len: 0 microversion: 2.1 time: 0.022033 Apr 12 00:40:40 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 198/583] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 00:40:40 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1703783656 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:40:40 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-1328da55-81a6-4cd5-a672-e201f6679b44 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Action: 'create', calling method: .version_select at 0x7f7cd46eba30>, body: {"keypair": {"name": "tempest-keypair-289836934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWGj7dSQHVA/HrEtaB4DJigDG9Mzlx8PMjbhwOxrK2TUFxfhn0D8YVV6DDvZ+svIniFEYTa7iGPRsIpVwCvT8L2WyFqHYxb0W0vFI6wRmarN6uFa/j/PlGTywze+bhPSg=="}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:40 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-1328da55-81a6-4cd5-a672-e201f6679b44 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Getting quotas for project b56f3c567dc84773a33d596920df727a. Resources: {'key_pairs'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:40:40 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-1328da55-81a6-4cd5-a672-e201f6679b44 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Getting quotas for user d373f582479c441e8ce9849ca694a186 and project b56f3c567dc84773a33d596920df727a. Resources: {'key_pairs'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:40:41 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-1328da55-81a6-4cd5-a672-e201f6679b44 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051562 Apr 12 00:40:41 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 194/584] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 00:40:40 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:41 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-c675aa07-e4fd-48d5-91ce-5b1c30718566 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Action: 'create', calling method: .version_select at 0x7f7cd48d6050>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1878126979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLL4sWycAZqaJHRHFapLIEJKRTPT4ZG/EwN/3TZ+DPO7pKSrr57Kz68Tv7okIte1TRRDN2A02x4unzAOhLPF2yhqVLzmR1VEXp8ouvnz90L4NZ4XAtVqAqRq5mcX6FpTrw=="}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:41 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-c675aa07-e4fd-48d5-91ce-5b1c30718566 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Getting quotas for project e66fda80cb83402392e155c76ee78e1f. Resources: {'key_pairs'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:40:41 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-c675aa07-e4fd-48d5-91ce-5b1c30718566 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Getting quotas for user 2842535891eb4a9880f7e8859dd0de3c and project e66fda80cb83402392e155c76ee78e1f. Resources: {'key_pairs'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:40:41 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-c675aa07-e4fd-48d5-91ce-5b1c30718566 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.054927 Apr 12 00:40:41 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 193/585] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 00:40:41 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:41 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-4294683", "imageRef": "2317fabf-b690-45f6-b138-d4e83ea7d334", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1878126979", "networks": [{"uuid": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86"}]}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:41 user devstack@n-api.service[72496]: DEBUG nova.network.neutron [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] validate_networks() for [('f0cb3c70-3fb7-45b5-8454-846b0c4b7a86', None, None, None, None, None)] {{(pid=72496) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:40:41 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-5b3621cb-1418-4788-b0db-5aac928cc7d2 req-d55b8b6a-f010-4bb8-9472-8d7dd9c36f67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3", "name": "network-vif-deleted", "tag": "40e300fb-a2c9-4770-8eee-d1b48baedf34"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-5b3621cb-1418-4788-b0db-5aac928cc7d2 req-d55b8b6a-f010-4bb8-9472-8d7dd9c36f67 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-5b3621cb-1418-4788-b0db-5aac928cc7d2 req-d55b8b6a-f010-4bb8-9472-8d7dd9c36f67 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-5b3621cb-1418-4788-b0db-5aac928cc7d2 req-d55b8b6a-f010-4bb8-9472-8d7dd9c36f67 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:41 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-5b3621cb-1418-4788-b0db-5aac928cc7d2 req-d55b8b6a-f010-4bb8-9472-8d7dd9c36f67 service nova] Creating event network-vif-deleted:40e300fb-a2c9-4770-8eee-d1b48baedf34 for instance 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 on user Apr 12 00:40:41 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-5b3621cb-1418-4788-b0db-5aac928cc7d2 req-d55b8b6a-f010-4bb8-9472-8d7dd9c36f67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102534 Apr 12 00:40:41 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 195/586] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:40:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:41 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-a073ab02-21e6-4722-ac46-bf8c52af5727 req-5d5dd6e6-9e37-4416-91ae-9db2524e8ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3", "name": "network-vif-unplugged", "status": "completed", "tag": "40e300fb-a2c9-4770-8eee-d1b48baedf34"}, {"server_uuid": "88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3", "name": "network-vif-plugged", "status": "completed", "tag": "40e300fb-a2c9-4770-8eee-d1b48baedf34"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:41 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a073ab02-21e6-4722-ac46-bf8c52af5727 req-5d5dd6e6-9e37-4416-91ae-9db2524e8ba9 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:41 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a073ab02-21e6-4722-ac46-bf8c52af5727 req-5d5dd6e6-9e37-4416-91ae-9db2524e8ba9 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:41 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a073ab02-21e6-4722-ac46-bf8c52af5727 req-5d5dd6e6-9e37-4416-91ae-9db2524e8ba9 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:41 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-a073ab02-21e6-4722-ac46-bf8c52af5727 req-5d5dd6e6-9e37-4416-91ae-9db2524e8ba9 service nova] Creating event network-vif-unplugged:40e300fb-a2c9-4770-8eee-d1b48baedf34 for instance 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 on user Apr 12 00:40:41 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-a073ab02-21e6-4722-ac46-bf8c52af5727 req-5d5dd6e6-9e37-4416-91ae-9db2524e8ba9 service nova] Creating event network-vif-plugged:40e300fb-a2c9-4770-8eee-d1b48baedf34 for instance 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 on user Apr 12 00:40:41 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-a073ab02-21e6-4722-ac46-bf8c52af5727 req-5d5dd6e6-9e37-4416-91ae-9db2524e8ba9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.037008 Apr 12 00:40:41 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 194/587] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:40:41 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:42 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Flavor limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:40:42 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Image limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:40:42 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Flavor pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:40:42 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Image pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:40:42 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:40:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:42 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Getting quotas for project e66fda80cb83402392e155c76ee78e1f. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:40:42 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Getting quotas for user 2842535891eb4a9880f7e8859dd0de3c and project e66fda80cb83402392e155c76ee78e1f. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:40:42 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Going to run 1 instances... {{(pid=72496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:40:42 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2317fabf-b690-45f6-b138-d4e83ea7d334',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:40:42 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-454f66f9-e74d-46aa-8529-4c7ea7e19af8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.961030 Apr 12 00:40:42 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 199/588] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:40:41 2023] POST /compute/v2.1/servers => generated 378 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:40:42 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-f7b77017-99c7-4a79-8ec6-44e401805257 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:42 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-f7b77017-99c7-4a79-8ec6-44e401805257 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:40:42 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-f7b77017-99c7-4a79-8ec6-44e401805257 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842535891eb4a9880f7e8859dd0de3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66fda80cb83402392e155c76ee78e1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:40:42 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-f7b77017-99c7-4a79-8ec6-44e401805257 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763" status: 200 len: 1250 microversion: 2.1 time: 0.074126 Apr 12 00:40:42 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 196/589] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:40:42 2023] GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763 => generated 1250 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:43 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-390611439", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1"}], "security_groups": [{"name": "tempest-securitygroup--1044623998"}], "key_name": "tempest-keypair-289836934", "user_data": "}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:43 user devstack@n-api.service[72495]: DEBUG nova.network.neutron [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] validate_networks() for [('df248eb3-f39c-4a81-aca0-6c2d01f6d2b1', None, None, None, None, None)] {{(pid=72495) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:40:43 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Flavor limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:40:43 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Image limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:40:43 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Flavor pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:40:43 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Image pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:40:43 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:40:43 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:43 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:43 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:43 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:43 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:43 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:43 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Getting quotas for project b56f3c567dc84773a33d596920df727a. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:40:43 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Getting quotas for user d373f582479c441e8ce9849ca694a186 and project b56f3c567dc84773a33d596920df727a. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:40:43 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Going to run 1 instances... {{(pid=72495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:40:43 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:40:43 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-4c6e58d2-ac0e-40e8-8981-b0fb1bc57fec tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.665144 Apr 12 00:40:43 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 195/590] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:40:43 2023] POST /compute/v2.1/servers => generated 400 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:40:43 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-84bc7aea-0800-48d7-aead-7828b42090ff tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:40:43 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-84bc7aea-0800-48d7-aead-7828b42090ff tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:40:43 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-84bc7aea-0800-48d7-aead-7828b42090ff tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373f582479c441e8ce9849ca694a186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f3c567dc84773a33d596920df727a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:40:43 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-84bc7aea-0800-48d7-aead-7828b42090ff tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d" status: 200 len: 1234 microversion: 2.1 time: 0.089947 Apr 12 00:40:43 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 200/591] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:40:43 2023] GET /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d => generated 1234 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:40:45 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-f995463f-26e4-4a71-bce8-d480cdce0a8e req-4854dded-ddfd-4023-9485-d3166d60003e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c57eddf0-bf85-4b87-a352-57508a728763", "tag": "d1cda216-0dbb-4296-81c2-9386697372d2"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:45 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f995463f-26e4-4a71-bce8-d480cdce0a8e req-4854dded-ddfd-4023-9485-d3166d60003e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:45 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f995463f-26e4-4a71-bce8-d480cdce0a8e req-4854dded-ddfd-4023-9485-d3166d60003e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:45 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f995463f-26e4-4a71-bce8-d480cdce0a8e req-4854dded-ddfd-4023-9485-d3166d60003e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:45 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-f995463f-26e4-4a71-bce8-d480cdce0a8e req-4854dded-ddfd-4023-9485-d3166d60003e service nova] Creating event network-changed:d1cda216-0dbb-4296-81c2-9386697372d2 for instance c57eddf0-bf85-4b87-a352-57508a728763 on user Apr 12 00:40:45 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-f995463f-26e4-4a71-bce8-d480cdce0a8e req-4854dded-ddfd-4023-9485-d3166d60003e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028996 Apr 12 00:40:45 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 197/592] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:40:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:40:47 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-b93156b8-fbae-467f-bff4-fc255989e3ce req-73758b29-2bac-4766-858f-7f5015f29b70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d677c2bb-77e2-40f3-8c3a-f15c9f75276d", "tag": "f34869ea-bee8-482e-a9eb-9d9c7414a17c"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-b93156b8-fbae-467f-bff4-fc255989e3ce req-73758b29-2bac-4766-858f-7f5015f29b70 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-b93156b8-fbae-467f-bff4-fc255989e3ce req-73758b29-2bac-4766-858f-7f5015f29b70 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-b93156b8-fbae-467f-bff4-fc255989e3ce req-73758b29-2bac-4766-858f-7f5015f29b70 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:47 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-b93156b8-fbae-467f-bff4-fc255989e3ce req-73758b29-2bac-4766-858f-7f5015f29b70 service nova] Creating event network-changed:f34869ea-bee8-482e-a9eb-9d9c7414a17c for instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d on user Apr 12 00:40:47 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-b93156b8-fbae-467f-bff4-fc255989e3ce req-73758b29-2bac-4766-858f-7f5015f29b70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031253 Apr 12 00:40:47 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 196/593] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:40:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:48 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-a3dfec5e-6a04-4704-9e67-156fa31a4aea req-a122623f-bddf-4fbd-81f3-45510ce659c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c57eddf0-bf85-4b87-a352-57508a728763", "name": "network-vif-plugged", "status": "completed", "tag": "d1cda216-0dbb-4296-81c2-9386697372d2"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:48 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-a3dfec5e-6a04-4704-9e67-156fa31a4aea req-a122623f-bddf-4fbd-81f3-45510ce659c0 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:48 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-a3dfec5e-6a04-4704-9e67-156fa31a4aea req-a122623f-bddf-4fbd-81f3-45510ce659c0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:48 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-a3dfec5e-6a04-4704-9e67-156fa31a4aea req-a122623f-bddf-4fbd-81f3-45510ce659c0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:48 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-a3dfec5e-6a04-4704-9e67-156fa31a4aea req-a122623f-bddf-4fbd-81f3-45510ce659c0 service nova] Creating event network-vif-plugged:d1cda216-0dbb-4296-81c2-9386697372d2 for instance c57eddf0-bf85-4b87-a352-57508a728763 on user Apr 12 00:40:48 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-a3dfec5e-6a04-4704-9e67-156fa31a4aea req-a122623f-bddf-4fbd-81f3-45510ce659c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037314 Apr 12 00:40:48 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 201/594] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:40:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:50 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-5436aef6-23ad-4a0d-b826-9b7450498bab req-71609168-8964-48bb-8b32-226f4b0d25a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c57eddf0-bf85-4b87-a352-57508a728763", "name": "network-vif-plugged", "status": "completed", "tag": "d1cda216-0dbb-4296-81c2-9386697372d2"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-5436aef6-23ad-4a0d-b826-9b7450498bab req-71609168-8964-48bb-8b32-226f4b0d25a3 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-5436aef6-23ad-4a0d-b826-9b7450498bab req-71609168-8964-48bb-8b32-226f4b0d25a3 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-5436aef6-23ad-4a0d-b826-9b7450498bab req-71609168-8964-48bb-8b32-226f4b0d25a3 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:50 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-5436aef6-23ad-4a0d-b826-9b7450498bab req-71609168-8964-48bb-8b32-226f4b0d25a3 service nova] Creating event network-vif-plugged:d1cda216-0dbb-4296-81c2-9386697372d2 for instance c57eddf0-bf85-4b87-a352-57508a728763 on user Apr 12 00:40:50 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-5436aef6-23ad-4a0d-b826-9b7450498bab req-71609168-8964-48bb-8b32-226f4b0d25a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031490 Apr 12 00:40:50 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 198/595] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:40:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:50 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-c24eb2ab-6cb8-4460-96b0-0d86594d5a3a req-10034290-8e35-4a38-816b-a0918b93b3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe6d6bc-65a6-469a-89a0-7e4c51620b14", "name": "network-vif-plugged", "status": "completed", "tag": "b99b54c2-0b21-42ea-91d0-087aa230da7e"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-c24eb2ab-6cb8-4460-96b0-0d86594d5a3a req-10034290-8e35-4a38-816b-a0918b93b3c2 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-c24eb2ab-6cb8-4460-96b0-0d86594d5a3a req-10034290-8e35-4a38-816b-a0918b93b3c2 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-c24eb2ab-6cb8-4460-96b0-0d86594d5a3a req-10034290-8e35-4a38-816b-a0918b93b3c2 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:50 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-c24eb2ab-6cb8-4460-96b0-0d86594d5a3a req-10034290-8e35-4a38-816b-a0918b93b3c2 service nova] Creating event network-vif-plugged:b99b54c2-0b21-42ea-91d0-087aa230da7e for instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 on user Apr 12 00:40:50 user devstack@n-api.service[72495]: DEBUG nova.compute.api [req-c24eb2ab-6cb8-4460-96b0-0d86594d5a3a req-10034290-8e35-4a38-816b-a0918b93b3c2 service nova] Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72495) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 00:40:50 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-c24eb2ab-6cb8-4460-96b0-0d86594d5a3a req-10034290-8e35-4a38-816b-a0918b93b3c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039190 Apr 12 00:40:50 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 197/596] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:40:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:50 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-fca0cd38-dcbb-4e61-875c-492a08ce5495 req-eb766b98-c085-4ec4-9854-9ae7c328e3be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d677c2bb-77e2-40f3-8c3a-f15c9f75276d", "name": "network-vif-plugged", "status": "completed", "tag": "f34869ea-bee8-482e-a9eb-9d9c7414a17c"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-fca0cd38-dcbb-4e61-875c-492a08ce5495 req-eb766b98-c085-4ec4-9854-9ae7c328e3be service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-fca0cd38-dcbb-4e61-875c-492a08ce5495 req-eb766b98-c085-4ec4-9854-9ae7c328e3be service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-fca0cd38-dcbb-4e61-875c-492a08ce5495 req-eb766b98-c085-4ec4-9854-9ae7c328e3be service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:51 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-fca0cd38-dcbb-4e61-875c-492a08ce5495 req-eb766b98-c085-4ec4-9854-9ae7c328e3be service nova] Creating event network-vif-plugged:f34869ea-bee8-482e-a9eb-9d9c7414a17c for instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d on user Apr 12 00:40:51 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-fca0cd38-dcbb-4e61-875c-492a08ce5495 req-eb766b98-c085-4ec4-9854-9ae7c328e3be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073255 Apr 12 00:40:51 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 202/597] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:40:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:52 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=6 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:40:52 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-4f78d88c-9ddf-449a-8a6b-69b892b28270 req-7bb577ce-b856-4c6e-9a57-d69e5087487e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe6d6bc-65a6-469a-89a0-7e4c51620b14", "name": "network-vif-plugged", "status": "completed", "tag": "b99b54c2-0b21-42ea-91d0-087aa230da7e"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-4f78d88c-9ddf-449a-8a6b-69b892b28270 req-7bb577ce-b856-4c6e-9a57-d69e5087487e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-4f78d88c-9ddf-449a-8a6b-69b892b28270 req-7bb577ce-b856-4c6e-9a57-d69e5087487e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-4f78d88c-9ddf-449a-8a6b-69b892b28270 req-7bb577ce-b856-4c6e-9a57-d69e5087487e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:52 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-4f78d88c-9ddf-449a-8a6b-69b892b28270 req-7bb577ce-b856-4c6e-9a57-d69e5087487e service nova] Creating event network-vif-plugged:b99b54c2-0b21-42ea-91d0-087aa230da7e for instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 on user Apr 12 00:40:52 user devstack@n-api.service[72494]: DEBUG nova.compute.api [req-4f78d88c-9ddf-449a-8a6b-69b892b28270 req-7bb577ce-b856-4c6e-9a57-d69e5087487e service nova] Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 00:40:52 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-4f78d88c-9ddf-449a-8a6b-69b892b28270 req-7bb577ce-b856-4c6e-9a57-d69e5087487e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059196 Apr 12 00:40:52 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 199/598] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:40:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:40:53 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-f4849f58-fe80-4723-bcea-8de1005cbc64 req-5a6af697-1a7a-4f55-8aba-678ec499cff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d677c2bb-77e2-40f3-8c3a-f15c9f75276d", "name": "network-vif-plugged", "status": "completed", "tag": "f34869ea-bee8-482e-a9eb-9d9c7414a17c"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:40:53 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-f4849f58-fe80-4723-bcea-8de1005cbc64 req-5a6af697-1a7a-4f55-8aba-678ec499cff9 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:40:53 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-f4849f58-fe80-4723-bcea-8de1005cbc64 req-5a6af697-1a7a-4f55-8aba-678ec499cff9 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:40:53 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-f4849f58-fe80-4723-bcea-8de1005cbc64 req-5a6af697-1a7a-4f55-8aba-678ec499cff9 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:40:53 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-f4849f58-fe80-4723-bcea-8de1005cbc64 req-5a6af697-1a7a-4f55-8aba-678ec499cff9 service nova] Creating event network-vif-plugged:f34869ea-bee8-482e-a9eb-9d9c7414a17c for instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d on user Apr 12 00:40:53 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-f4849f58-fe80-4723-bcea-8de1005cbc64 req-5a6af697-1a7a-4f55-8aba-678ec499cff9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031655 Apr 12 00:40:53 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 198/599] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:40:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:41:08 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:41:08 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=8 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:41:08 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:41:08 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:41:08 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-a53a8e17-17b8-4947-936f-a3f065eba67b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:41:08 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-a53a8e17-17b8-4947-936f-a3f065eba67b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:41:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a53a8e17-17b8-4947-936f-a3f065eba67b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a53a8e17-17b8-4947-936f-a3f065eba67b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a53a8e17-17b8-4947-936f-a3f065eba67b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a53a8e17-17b8-4947-936f-a3f065eba67b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a53a8e17-17b8-4947-936f-a3f065eba67b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a53a8e17-17b8-4947-936f-a3f065eba67b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:08 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-a53a8e17-17b8-4947-936f-a3f065eba67b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9421443b2f421298a934122c6a8b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf1fea74ef143e6b394e41e7c4ed495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:41:08 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-a53a8e17-17b8-4947-936f-a3f065eba67b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d" status: 200 len: 1703 microversion: 2.1 time: 0.291473 Apr 12 00:41:08 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 203/600] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:41:08 2023] GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d => generated 1703 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:41:11 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:41:11 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:41:11 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-5af454b9-3338-4c8f-ad46-569bd8bfb2e1 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:41:11 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-5af454b9-3338-4c8f-ad46-569bd8bfb2e1 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:41:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5af454b9-3338-4c8f-ad46-569bd8bfb2e1 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5af454b9-3338-4c8f-ad46-569bd8bfb2e1 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5af454b9-3338-4c8f-ad46-569bd8bfb2e1 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5af454b9-3338-4c8f-ad46-569bd8bfb2e1 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5af454b9-3338-4c8f-ad46-569bd8bfb2e1 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5af454b9-3338-4c8f-ad46-569bd8bfb2e1 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:11 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-5af454b9-3338-4c8f-ad46-569bd8bfb2e1 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:41:11 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-5af454b9-3338-4c8f-ad46-569bd8bfb2e1 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:41:11 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-5af454b9-3338-4c8f-ad46-569bd8bfb2e1 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:41:11 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-5af454b9-3338-4c8f-ad46-569bd8bfb2e1 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1277a40a-6389-4d88-bbc6-bda27d465c35" status: 200 len: 1768 microversion: 2.87 time: 0.164222 Apr 12 00:41:11 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 200/601] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:41:11 2023] GET /compute/v2.1/servers/1277a40a-6389-4d88-bbc6-bda27d465c35 => generated 1768 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:41:14 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:41:14 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=10 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:41:14 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:41:14 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=24 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:41:14 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-46447696-e9bf-427c-a44c-c268d4aeb3d8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:41:14 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-46447696-e9bf-427c-a44c-c268d4aeb3d8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:41:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-46447696-e9bf-427c-a44c-c268d4aeb3d8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-46447696-e9bf-427c-a44c-c268d4aeb3d8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-46447696-e9bf-427c-a44c-c268d4aeb3d8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-46447696-e9bf-427c-a44c-c268d4aeb3d8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-46447696-e9bf-427c-a44c-c268d4aeb3d8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-46447696-e9bf-427c-a44c-c268d4aeb3d8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:14 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-46447696-e9bf-427c-a44c-c268d4aeb3d8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:41:14 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-46447696-e9bf-427c-a44c-c268d4aeb3d8 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ecfc9ba1-d560-410d-af55-8d5e578aa00d" status: 200 len: 1442 microversion: 2.1 time: 0.302312 Apr 12 00:41:14 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 199/602] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:41:14 2023] GET /compute/v2.1/servers/ecfc9ba1-d560-410d-af55-8d5e578aa00d => generated 1442 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:41:15 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-5b3dd128-6eff-4242-bb2c-c1a32625c822 req-b052883d-8287-4ffc-8c41-5875bd2cce32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecfc9ba1-d560-410d-af55-8d5e578aa00d", "tag": "d71af90a-89b8-414c-9bac-b2a9605aeec5"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:41:16 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-5b3dd128-6eff-4242-bb2c-c1a32625c822 req-b052883d-8287-4ffc-8c41-5875bd2cce32 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:16 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-5b3dd128-6eff-4242-bb2c-c1a32625c822 req-b052883d-8287-4ffc-8c41-5875bd2cce32 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:16 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-5b3dd128-6eff-4242-bb2c-c1a32625c822 req-b052883d-8287-4ffc-8c41-5875bd2cce32 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:16 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-5b3dd128-6eff-4242-bb2c-c1a32625c822 req-b052883d-8287-4ffc-8c41-5875bd2cce32 service nova] Creating event network-changed:d71af90a-89b8-414c-9bac-b2a9605aeec5 for instance ecfc9ba1-d560-410d-af55-8d5e578aa00d on user Apr 12 00:41:16 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-5b3dd128-6eff-4242-bb2c-c1a32625c822 req-b052883d-8287-4ffc-8c41-5875bd2cce32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033154 Apr 12 00:41:16 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 204/603] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:41:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:41:16 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:41:16 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:41:16 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:16 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:16 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:16 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:16 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:16 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:16 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Going to try to terminate instance {{(pid=72494) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:41:16 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-305e0baa-e53c-4e49-a309-4c0a60145881 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ecfc9ba1-d560-410d-af55-8d5e578aa00d" status: 204 len: 0 microversion: 2.1 time: 0.123396 Apr 12 00:41:16 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 201/604] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:41:16 2023] DELETE /compute/v2.1/servers/ecfc9ba1-d560-410d-af55-8d5e578aa00d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:41:16 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-0cc82d49-4e05-4033-bbb2-e769ad0b7647 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:41:16 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-0cc82d49-4e05-4033-bbb2-e769ad0b7647 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:41:16 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-0cc82d49-4e05-4033-bbb2-e769ad0b7647 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:16 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-0cc82d49-4e05-4033-bbb2-e769ad0b7647 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:16 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-0cc82d49-4e05-4033-bbb2-e769ad0b7647 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:16 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-0cc82d49-4e05-4033-bbb2-e769ad0b7647 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:16 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-0cc82d49-4e05-4033-bbb2-e769ad0b7647 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:16 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-0cc82d49-4e05-4033-bbb2-e769ad0b7647 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:16 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-0cc82d49-4e05-4033-bbb2-e769ad0b7647 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:41:16 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-0cc82d49-4e05-4033-bbb2-e769ad0b7647 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ecfc9ba1-d560-410d-af55-8d5e578aa00d" status: 200 len: 1448 microversion: 2.1 time: 0.238889 Apr 12 00:41:16 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 200/605] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:41:16 2023] GET /compute/v2.1/servers/ecfc9ba1-d560-410d-af55-8d5e578aa00d => generated 1448 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:41:16 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-f24ac121-4a74-4d89-b814-62d5a6c831a5 req-fe8d1f92-35f1-4249-92ea-61ca4938fdb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecfc9ba1-d560-410d-af55-8d5e578aa00d", "name": "network-vif-unplugged", "status": "completed", "tag": "d71af90a-89b8-414c-9bac-b2a9605aeec5"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:41:16 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-f24ac121-4a74-4d89-b814-62d5a6c831a5 req-fe8d1f92-35f1-4249-92ea-61ca4938fdb4 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:16 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-f24ac121-4a74-4d89-b814-62d5a6c831a5 req-fe8d1f92-35f1-4249-92ea-61ca4938fdb4 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:16 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-f24ac121-4a74-4d89-b814-62d5a6c831a5 req-fe8d1f92-35f1-4249-92ea-61ca4938fdb4 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:16 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-f24ac121-4a74-4d89-b814-62d5a6c831a5 req-fe8d1f92-35f1-4249-92ea-61ca4938fdb4 service nova] Creating event network-vif-unplugged:d71af90a-89b8-414c-9bac-b2a9605aeec5 for instance ecfc9ba1-d560-410d-af55-8d5e578aa00d on user Apr 12 00:41:16 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-f24ac121-4a74-4d89-b814-62d5a6c831a5 req-fe8d1f92-35f1-4249-92ea-61ca4938fdb4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030803 Apr 12 00:41:16 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 205/606] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:41:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:41:18 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-c039549d-0b72-4e05-b976-4ec1ea53036e req-939b10ff-9dd5-44fa-bc64-b868486e7bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecfc9ba1-d560-410d-af55-8d5e578aa00d", "name": "network-vif-plugged", "status": "completed", "tag": "d71af90a-89b8-414c-9bac-b2a9605aeec5"}, {"server_uuid": "ecfc9ba1-d560-410d-af55-8d5e578aa00d", "name": "network-vif-deleted", "tag": "d71af90a-89b8-414c-9bac-b2a9605aeec5"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:41:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-c039549d-0b72-4e05-b976-4ec1ea53036e req-939b10ff-9dd5-44fa-bc64-b868486e7bc7 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-c039549d-0b72-4e05-b976-4ec1ea53036e req-939b10ff-9dd5-44fa-bc64-b868486e7bc7 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-c039549d-0b72-4e05-b976-4ec1ea53036e req-939b10ff-9dd5-44fa-bc64-b868486e7bc7 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:18 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-c039549d-0b72-4e05-b976-4ec1ea53036e req-939b10ff-9dd5-44fa-bc64-b868486e7bc7 service nova] Creating event network-vif-plugged:d71af90a-89b8-414c-9bac-b2a9605aeec5 for instance ecfc9ba1-d560-410d-af55-8d5e578aa00d on user Apr 12 00:41:18 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-c039549d-0b72-4e05-b976-4ec1ea53036e req-939b10ff-9dd5-44fa-bc64-b868486e7bc7 service nova] Creating event network-vif-deleted:d71af90a-89b8-414c-9bac-b2a9605aeec5 for instance ecfc9ba1-d560-410d-af55-8d5e578aa00d on user Apr 12 00:41:18 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-c039549d-0b72-4e05-b976-4ec1ea53036e req-939b10ff-9dd5-44fa-bc64-b868486e7bc7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031373 Apr 12 00:41:18 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 202/607] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:41:18 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:41:26 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-9490663d-c3a1-424d-b11c-e920ac885124 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:41:26 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-9490663d-c3a1-424d-b11c-e920ac885124 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:41:26 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:41:26 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=12 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:41:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9490663d-c3a1-424d-b11c-e920ac885124 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9490663d-c3a1-424d-b11c-e920ac885124 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9490663d-c3a1-424d-b11c-e920ac885124 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9490663d-c3a1-424d-b11c-e920ac885124 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9490663d-c3a1-424d-b11c-e920ac885124 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9490663d-c3a1-424d-b11c-e920ac885124 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:26 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-9490663d-c3a1-424d-b11c-e920ac885124 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:41:26 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-9490663d-c3a1-424d-b11c-e920ac885124 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 200 len: 1722 microversion: 2.1 time: 0.284545 Apr 12 00:41:26 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 201/608] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:41:26 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 1722 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:41:29 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:41:29 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=10 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:41:29 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-4247bb77-dcee-4b6b-a61b-5ccbd55b465c tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:41:29 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-4247bb77-dcee-4b6b-a61b-5ccbd55b465c tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] [instance: 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:41:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4247bb77-dcee-4b6b-a61b-5ccbd55b465c tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4247bb77-dcee-4b6b-a61b-5ccbd55b465c tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4247bb77-dcee-4b6b-a61b-5ccbd55b465c tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4247bb77-dcee-4b6b-a61b-5ccbd55b465c tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4247bb77-dcee-4b6b-a61b-5ccbd55b465c tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4247bb77-dcee-4b6b-a61b-5ccbd55b465c tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:29 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-4247bb77-dcee-4b6b-a61b-5ccbd55b465c tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] HTTP exception thrown: Instance 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 could not be found. Apr 12 00:41:29 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-4247bb77-dcee-4b6b-a61b-5ccbd55b465c tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Request method failure captured: Apr 12 00:41:29 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 HTTP/1.1 Apr 12 00:41:29 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:41:29 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:41:29 user devstack@n-api.service[72496]: Connection: close Apr 12 00:41:29 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:41:29 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:41:29 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:41:29 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:41:29 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:41:29 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNfyr91gvqMcsaXhrtbVzq7_ojUHwoHryhp7hXJvBLoo83DG-0pnXUpdKNwAknAiiO4FAgAA_PmenTqvCUT90FtLSJPGun8zpmlwMQ7AxNvA1jE1OMlAY_cRJkmx3FdD0hpHsnBEvJEmqzOF6ETlWs9W8Zef7R_e51zNh-sly678jh_0 Apr 12 00:41:29 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:41:29 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:41:29 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:41:29 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:41:29 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:41:29 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:41:29 user devstack@n-api.service[72496]: X-Project-Id: a8c1003f0d1847b7b4c679b0f7cc3110 Apr 12 00:41:29 user devstack@n-api.service[72496]: X-Project-Name: tempest-VolumesAdminNegativeTest-1593136751 Apr 12 00:41:29 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:41:29 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:41:29 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8c1003f0d1847b7b4c679b0f7cc3110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a8c1003f0d1847b7b4c679b0f7cc3110"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a8c1003f0d1847b7b4c679b0f7cc3110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:41:29 user devstack@n-api.service[72496]: X-Tenant: tempest-VolumesAdminNegativeTest-1593136751 Apr 12 00:41:29 user devstack@n-api.service[72496]: X-Tenant-Id: a8c1003f0d1847b7b4c679b0f7cc3110 Apr 12 00:41:29 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1593136751 Apr 12 00:41:29 user devstack@n-api.service[72496]: X-User: tempest-VolumesAdminNegativeTest-1593136751-project-member Apr 12 00:41:29 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:41:29 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:41:29 user devstack@n-api.service[72496]: X-User-Id: c276268b63084515a43caa837af30fb1 Apr 12 00:41:29 user devstack@n-api.service[72496]: X-User-Name: tempest-VolumesAdminNegativeTest-1593136751-project-member Apr 12 00:41:29 user devstack@n-api.service[72496]: method: > Apr 12 00:41:29 user devstack@n-api.service[72496]: exception: Instance 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 could not be found. Apr 12 00:41:29 user devstack@n-api.service[72496]: action_args: {'id': '88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3'} Apr 12 00:41:29 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 could not be found. Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 could not be found. Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 could not be found. Apr 12 00:41:29 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:41:29 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-4247bb77-dcee-4b6b-a61b-5ccbd55b465c tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Returning 404 to user: Instance 88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:41:29 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-4247bb77-dcee-4b6b-a61b-5ccbd55b465c tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3" status: 404 len: 111 microversion: 2.1 time: 0.033319 Apr 12 00:41:29 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 206/609] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:41:29 2023] GET /compute/v2.1/servers/88ae4fd8-7b2d-40e8-8a61-9b6697fdb8a3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:41:29 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:41:29 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:41:29 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-e2a3260f-0625-48ab-8bde-9077585829a2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] Calling method '.version_select at 0x7f7cd4546a70>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:41:29 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-e2a3260f-0625-48ab-8bde-9077585829a2 tempest-VolumesAdminNegativeTest-1593136751 tempest-VolumesAdminNegativeTest-1593136751-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1911302712" status: 202 len: 0 microversion: 2.1 time: 0.027940 Apr 12 00:41:29 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 203/610] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 00:41:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1911302712 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:41:32 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-fd950bc2-40d3-492b-b794-2dd4e95e595f tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:41:32 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-fd950bc2-40d3-492b-b794-2dd4e95e595f tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:41:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-fd950bc2-40d3-492b-b794-2dd4e95e595f tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-fd950bc2-40d3-492b-b794-2dd4e95e595f tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-fd950bc2-40d3-492b-b794-2dd4e95e595f tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-fd950bc2-40d3-492b-b794-2dd4e95e595f tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-fd950bc2-40d3-492b-b794-2dd4e95e595f tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-fd950bc2-40d3-492b-b794-2dd4e95e595f tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:32 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-fd950bc2-40d3-492b-b794-2dd4e95e595f tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842535891eb4a9880f7e8859dd0de3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66fda80cb83402392e155c76ee78e1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:41:32 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-fd950bc2-40d3-492b-b794-2dd4e95e595f tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763" status: 200 len: 1533 microversion: 2.1 time: 0.194990 Apr 12 00:41:32 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 202/611] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:41:32 2023] GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763 => generated 1533 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:41:33 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-dfe51890-b9d7-42b1-9e19-8e1ddf80ca20 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:41:33 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-dfe51890-b9d7-42b1-9e19-8e1ddf80ca20 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:41:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-dfe51890-b9d7-42b1-9e19-8e1ddf80ca20 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-dfe51890-b9d7-42b1-9e19-8e1ddf80ca20 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-dfe51890-b9d7-42b1-9e19-8e1ddf80ca20 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-dfe51890-b9d7-42b1-9e19-8e1ddf80ca20 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-dfe51890-b9d7-42b1-9e19-8e1ddf80ca20 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-dfe51890-b9d7-42b1-9e19-8e1ddf80ca20 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:34 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-dfe51890-b9d7-42b1-9e19-8e1ddf80ca20 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373f582479c441e8ce9849ca694a186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f3c567dc84773a33d596920df727a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:41:34 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-dfe51890-b9d7-42b1-9e19-8e1ddf80ca20 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d" status: 200 len: 1545 microversion: 2.1 time: 0.156708 Apr 12 00:41:34 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 207/612] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:41:33 2023] GET /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d => generated 1545 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:41:45 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:41:45 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-815753218", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "networks": [{"uuid": "3dfa9dbc-d877-4862-b0c4-315d842bc2de"}]}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:41:45 user devstack@n-api.service[72494]: DEBUG nova.network.neutron [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] validate_networks() for [('3dfa9dbc-d877-4862-b0c4-315d842bc2de', None, None, None, None, None)] {{(pid=72494) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:41:46 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Flavor limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:41:46 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Image limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:41:46 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Flavor pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:41:46 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Image pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:41:46 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:41:46 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:46 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:46 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:46 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:46 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:46 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:46 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Getting quotas for project af94aa5f596c49c08359724ef6780f94. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:41:46 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Getting quotas for user 6d5c08640a8b4472a99ea037612a1332 and project af94aa5f596c49c08359724ef6780f94. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:41:46 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Going to run 1 instances... {{(pid=72494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:41:46 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:41:46 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-857806b7-47e5-4f47-9946-98276b272ea4 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.697114 Apr 12 00:41:46 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 204/613] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:41:45 2023] POST /compute/v2.1/servers => generated 378 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:41:46 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-e96f9c90-3ede-46b5-88bb-94541974bf1c tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:41:46 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-e96f9c90-3ede-46b5-88bb-94541974bf1c tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:41:46 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:41:46 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=12 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:41:46 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-e96f9c90-3ede-46b5-88bb-94541974bf1c tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5c08640a8b4472a99ea037612a1332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af94aa5f596c49c08359724ef6780f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:41:46 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-e96f9c90-3ede-46b5-88bb-94541974bf1c tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] 10.0.0.210 "GET /compute/v2.1/servers/334c6825-035f-454c-9804-00ab537f54d1" status: 200 len: 1208 microversion: 2.1 time: 0.080567 Apr 12 00:41:46 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 203/614] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:41:46 2023] GET /compute/v2.1/servers/334c6825-035f-454c-9804-00ab537f54d1 => generated 1208 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:41:48 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-4c56ecc4-7bc4-459c-9457-5cb15ddda75c req-ffab1a1a-3603-4725-92f2-912bd14ef6af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "334c6825-035f-454c-9804-00ab537f54d1", "tag": "8c84814e-5562-4740-8e7a-565fbeefa36f"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:41:48 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:41:48 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=8 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:41:48 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4c56ecc4-7bc4-459c-9457-5cb15ddda75c req-ffab1a1a-3603-4725-92f2-912bd14ef6af service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:48 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4c56ecc4-7bc4-459c-9457-5cb15ddda75c req-ffab1a1a-3603-4725-92f2-912bd14ef6af service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:48 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4c56ecc4-7bc4-459c-9457-5cb15ddda75c req-ffab1a1a-3603-4725-92f2-912bd14ef6af service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:48 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-4c56ecc4-7bc4-459c-9457-5cb15ddda75c req-ffab1a1a-3603-4725-92f2-912bd14ef6af service nova] Creating event network-changed:8c84814e-5562-4740-8e7a-565fbeefa36f for instance 334c6825-035f-454c-9804-00ab537f54d1 on user Apr 12 00:41:48 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-4c56ecc4-7bc4-459c-9457-5cb15ddda75c req-ffab1a1a-3603-4725-92f2-912bd14ef6af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036541 Apr 12 00:41:48 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 208/615] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:41:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:41:50 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-7bbf4c00-bf86-4c10-bbc9-23d9f79efce9 req-b8c8ac3e-9311-447f-b093-dbe9a15407b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "334c6825-035f-454c-9804-00ab537f54d1", "name": "network-vif-plugged", "status": "completed", "tag": "8c84814e-5562-4740-8e7a-565fbeefa36f"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:41:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-7bbf4c00-bf86-4c10-bbc9-23d9f79efce9 req-b8c8ac3e-9311-447f-b093-dbe9a15407b2 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-7bbf4c00-bf86-4c10-bbc9-23d9f79efce9 req-b8c8ac3e-9311-447f-b093-dbe9a15407b2 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-7bbf4c00-bf86-4c10-bbc9-23d9f79efce9 req-b8c8ac3e-9311-447f-b093-dbe9a15407b2 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:50 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-7bbf4c00-bf86-4c10-bbc9-23d9f79efce9 req-b8c8ac3e-9311-447f-b093-dbe9a15407b2 service nova] Creating event network-vif-plugged:8c84814e-5562-4740-8e7a-565fbeefa36f for instance 334c6825-035f-454c-9804-00ab537f54d1 on user Apr 12 00:41:50 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-7bbf4c00-bf86-4c10-bbc9-23d9f79efce9 req-b8c8ac3e-9311-447f-b093-dbe9a15407b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029214 Apr 12 00:41:50 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 205/616] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:41:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:41:52 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-4bdb7667-381b-43db-a571-86e4065a8f5e req-19dab456-cbab-45f9-8540-8d45f1165f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "334c6825-035f-454c-9804-00ab537f54d1", "name": "network-vif-plugged", "status": "completed", "tag": "8c84814e-5562-4740-8e7a-565fbeefa36f"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:41:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-4bdb7667-381b-43db-a571-86e4065a8f5e req-19dab456-cbab-45f9-8540-8d45f1165f54 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:41:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-4bdb7667-381b-43db-a571-86e4065a8f5e req-19dab456-cbab-45f9-8540-8d45f1165f54 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:41:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-4bdb7667-381b-43db-a571-86e4065a8f5e req-19dab456-cbab-45f9-8540-8d45f1165f54 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:41:52 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-4bdb7667-381b-43db-a571-86e4065a8f5e req-19dab456-cbab-45f9-8540-8d45f1165f54 service nova] Creating event network-vif-plugged:8c84814e-5562-4740-8e7a-565fbeefa36f for instance 334c6825-035f-454c-9804-00ab537f54d1 on user Apr 12 00:41:53 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-4bdb7667-381b-43db-a571-86e4065a8f5e req-19dab456-cbab-45f9-8540-8d45f1165f54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039677 Apr 12 00:41:53 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 204/617] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:41:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:06 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:42:06 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:42:06 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-00758bb4-9698-46ae-beb0-4dc21e0e6b6d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:06 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-00758bb4-9698-46ae-beb0-4dc21e0e6b6d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:06 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-00758bb4-9698-46ae-beb0-4dc21e0e6b6d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:06 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-00758bb4-9698-46ae-beb0-4dc21e0e6b6d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:06 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-00758bb4-9698-46ae-beb0-4dc21e0e6b6d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:06 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-00758bb4-9698-46ae-beb0-4dc21e0e6b6d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:06 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-00758bb4-9698-46ae-beb0-4dc21e0e6b6d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:06 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-00758bb4-9698-46ae-beb0-4dc21e0e6b6d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:06 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-00758bb4-9698-46ae-beb0-4dc21e0e6b6d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] HTTP exception thrown: Instance ecfc9ba1-d560-410d-af55-8d5e578aa00d could not be found. Apr 12 00:42:06 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-00758bb4-9698-46ae-beb0-4dc21e0e6b6d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Request method failure captured: Apr 12 00:42:06 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/ecfc9ba1-d560-410d-af55-8d5e578aa00d HTTP/1.1 Apr 12 00:42:06 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:42:06 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:42:06 user devstack@n-api.service[72496]: Connection: close Apr 12 00:42:06 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:42:06 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:42:06 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:42:06 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:42:06 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:42:06 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNfut1jPVwgpnHF2p4IDb8mw8QCnmrhPi1bglXERi9o-oc8KfA86Nj8qbMXqGPJ-Qu-hg1buox-hKkUkiuJLGP2TjR-hKqepkY3sMZyNoxK3mS9Lgsu4E_4fnuzEqTUjrpCZSmbPFt9R2omKh-uhIkWfp0X1fr8C_wHlflXHVBJsAvYQ Apr 12 00:42:06 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:42:06 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:42:06 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:42:06 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:42:06 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:42:06 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:42:06 user devstack@n-api.service[72496]: X-Project-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:42:06 user devstack@n-api.service[72496]: X-Project-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:42:06 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:42:06 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:42:06 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:42:06 user devstack@n-api.service[72496]: X-Tenant: tempest-TestVolumeBootPattern-726466832 Apr 12 00:42:06 user devstack@n-api.service[72496]: X-Tenant-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:42:06 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:42:06 user devstack@n-api.service[72496]: X-User: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:42:06 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:42:06 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:42:06 user devstack@n-api.service[72496]: X-User-Id: c479f6ae2f0d40908be9b07717ca3509 Apr 12 00:42:06 user devstack@n-api.service[72496]: X-User-Name: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:42:06 user devstack@n-api.service[72496]: method: > Apr 12 00:42:06 user devstack@n-api.service[72496]: exception: Instance ecfc9ba1-d560-410d-af55-8d5e578aa00d could not be found. Apr 12 00:42:06 user devstack@n-api.service[72496]: action_args: {'id': 'ecfc9ba1-d560-410d-af55-8d5e578aa00d'} Apr 12 00:42:06 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecfc9ba1-d560-410d-af55-8d5e578aa00d could not be found. Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecfc9ba1-d560-410d-af55-8d5e578aa00d could not be found. Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecfc9ba1-d560-410d-af55-8d5e578aa00d could not be found. Apr 12 00:42:06 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:42:06 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-00758bb4-9698-46ae-beb0-4dc21e0e6b6d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Returning 404 to user: Instance ecfc9ba1-d560-410d-af55-8d5e578aa00d could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:42:06 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-00758bb4-9698-46ae-beb0-4dc21e0e6b6d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ecfc9ba1-d560-410d-af55-8d5e578aa00d" status: 404 len: 111 microversion: 2.1 time: 0.036532 Apr 12 00:42:06 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 209/618] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:42:06 2023] GET /compute/v2.1/servers/ecfc9ba1-d560-410d-af55-8d5e578aa00d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:42:06 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:42:06 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=6 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:42:06 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:42:06 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=4 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:42:06 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1790407973", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1592613584", "security_groups": [{"name": "tempest-secgroup-smoke-1090038461"}], "block_device_mapping_v2": [{"uuid": "39255a99-7938-4a08-af09-fe2d718c4fda", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "159bca51-de37-4d87-9af5-ec97816a869c"}]}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:06 user devstack@n-api.service[72494]: DEBUG nova.network.neutron [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] validate_networks() for [('159bca51-de37-4d87-9af5-ec97816a869c', None, None, None, None, None)] {{(pid=72494) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:42:07 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flavor limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:42:07 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Image limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:42:07 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flavor pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:42:07 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Image pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:42:07 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:42:07 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:07 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:07 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:07 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:07 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:07 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:07 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting quotas for project e38a98bf1d964ee6bd2d0d05e97a283a. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:42:07 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting quotas for user c479f6ae2f0d40908be9b07717ca3509 and project e38a98bf1d964ee6bd2d0d05e97a283a. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:42:07 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Going to run 1 instances... {{(pid=72494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:42:07 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='39255a99-7938-4a08-af09-fe2d718c4fda',volume_size=None,volume_type=None)] {{(pid=72494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:42:07 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-d9ce0c92-ec85-4cae-891b-ecbe80cb458b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.705139 Apr 12 00:42:07 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 206/619] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:42:06 2023] POST /compute/v2.1/servers => generated 404 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:42:07 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-e4ea1084-cb42-4bb2-b0b0-d32680801589 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:07 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-e4ea1084-cb42-4bb2-b0b0-d32680801589 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:07 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:42:07 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:42:07 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:42:07 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-e4ea1084-cb42-4bb2-b0b0-d32680801589 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:42:07 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-e4ea1084-cb42-4bb2-b0b0-d32680801589 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/533174dc-5071-487b-9a2c-74cd7786af8a" status: 200 len: 1090 microversion: 2.1 time: 0.072821 Apr 12 00:42:07 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 205/620] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:42:07 2023] GET /compute/v2.1/servers/533174dc-5071-487b-9a2c-74cd7786af8a => generated 1090 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:42:08 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-9a2d8aad-d906-406c-a2fe-f81c16ebffe1 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:08 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-9a2d8aad-d906-406c-a2fe-f81c16ebffe1 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9a2d8aad-d906-406c-a2fe-f81c16ebffe1 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9a2d8aad-d906-406c-a2fe-f81c16ebffe1 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9a2d8aad-d906-406c-a2fe-f81c16ebffe1 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9a2d8aad-d906-406c-a2fe-f81c16ebffe1 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9a2d8aad-d906-406c-a2fe-f81c16ebffe1 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9a2d8aad-d906-406c-a2fe-f81c16ebffe1 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:08 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-9a2d8aad-d906-406c-a2fe-f81c16ebffe1 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] HTTP exception thrown: Cannot 'detach_volume' instance 49c8e8b7-1f91-4cf5-a222-c787a186444d while it is in vm_state rescued Apr 12 00:42:08 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-9a2d8aad-d906-406c-a2fe-f81c16ebffe1 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Request method failure captured: Apr 12 00:42:08 user devstack@n-api.service[72496]: request: DELETE /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d/os-volume_attachments/41a82ec2-4e13-4a4b-980f-66064c4ec035 HTTP/1.1 Apr 12 00:42:08 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:42:08 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:42:08 user devstack@n-api.service[72496]: Connection: close Apr 12 00:42:08 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:42:08 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:42:08 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:42:08 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:42:08 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:42:08 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNft5KIxwEgdwTqD-CgWzQHRf_FoqYilC4_z8sLEvoXo1R3M7HNE1MMy-1-GlWM0X8BruNgg2BCXLv_-0_S4kRyGh3lOQ6Sb9IfuhvN2rkuUyf5ySkxhKP32iNzWpbdPq8mfldEe_U0xhj5wtI02KiYIEO-zb6pTaOupaX4Sx0JOImss Apr 12 00:42:08 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:42:08 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:42:08 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:42:08 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:42:08 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:42:08 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:42:08 user devstack@n-api.service[72496]: X-Project-Id: fcf1fea74ef143e6b394e41e7c4ed495 Apr 12 00:42:08 user devstack@n-api.service[72496]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1300870234 Apr 12 00:42:08 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:42:08 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:42:08 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fcf1fea74ef143e6b394e41e7c4ed495"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fcf1fea74ef143e6b394e41e7c4ed495"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fcf1fea74ef143e6b394e41e7c4ed495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:42:08 user devstack@n-api.service[72496]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1300870234 Apr 12 00:42:08 user devstack@n-api.service[72496]: X-Tenant-Id: fcf1fea74ef143e6b394e41e7c4ed495 Apr 12 00:42:08 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1300870234 Apr 12 00:42:08 user devstack@n-api.service[72496]: X-User: tempest-ServerRescueNegativeTestJSON-1300870234-project-member Apr 12 00:42:08 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:42:08 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:42:08 user devstack@n-api.service[72496]: X-User-Id: 6b9421443b2f421298a934122c6a8b8c Apr 12 00:42:08 user devstack@n-api.service[72496]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1300870234-project-member Apr 12 00:42:08 user devstack@n-api.service[72496]: method: > Apr 12 00:42:08 user devstack@n-api.service[72496]: exception: Cannot 'detach_volume' instance 49c8e8b7-1f91-4cf5-a222-c787a186444d while it is in vm_state rescued Apr 12 00:42:08 user devstack@n-api.service[72496]: action_args: {'server_id': '49c8e8b7-1f91-4cf5-a222-c787a186444d', 'id': '41a82ec2-4e13-4a4b-980f-66064c4ec035'} Apr 12 00:42:08 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 49c8e8b7-1f91-4cf5-a222-c787a186444d in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 49c8e8b7-1f91-4cf5-a222-c787a186444d while it is in vm_state rescued Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 49c8e8b7-1f91-4cf5-a222-c787a186444d while it is in vm_state rescued Apr 12 00:42:08 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:42:08 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-9a2d8aad-d906-406c-a2fe-f81c16ebffe1 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Returning 409 to user: Cannot 'detach_volume' instance 49c8e8b7-1f91-4cf5-a222-c787a186444d while it is in vm_state rescued {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:42:08 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-9a2d8aad-d906-406c-a2fe-f81c16ebffe1 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d/os-volume_attachments/41a82ec2-4e13-4a4b-980f-66064c4ec035" status: 409 len: 152 microversion: 2.1 time: 0.107542 Apr 12 00:42:08 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 210/621] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 00:42:08 2023] DELETE /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d/os-volume_attachments/41a82ec2-4e13-4a4b-980f-66064c4ec035 => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 12 00:42:08 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-980b67c6-08c7-4021-a8fb-8bc0cf6cf2fc tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:08 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-980b67c6-08c7-4021-a8fb-8bc0cf6cf2fc tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:08 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-980b67c6-08c7-4021-a8fb-8bc0cf6cf2fc tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:08 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-980b67c6-08c7-4021-a8fb-8bc0cf6cf2fc tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:08 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-980b67c6-08c7-4021-a8fb-8bc0cf6cf2fc tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:08 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-980b67c6-08c7-4021-a8fb-8bc0cf6cf2fc tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:08 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-980b67c6-08c7-4021-a8fb-8bc0cf6cf2fc tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:08 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-980b67c6-08c7-4021-a8fb-8bc0cf6cf2fc tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:09 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-980b67c6-08c7-4021-a8fb-8bc0cf6cf2fc tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "POST /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d/action" status: 202 len: 0 microversion: 2.1 time: 0.077492 Apr 12 00:42:09 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 207/622] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 00:42:08 2023] POST /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:42:09 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-a87031e6-be8a-4fbd-b800-ae4b33c49730 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:09 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-a87031e6-be8a-4fbd-b800-ae4b33c49730 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:09 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-a87031e6-be8a-4fbd-b800-ae4b33c49730 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:09 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-a87031e6-be8a-4fbd-b800-ae4b33c49730 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:09 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-a87031e6-be8a-4fbd-b800-ae4b33c49730 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:09 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-a87031e6-be8a-4fbd-b800-ae4b33c49730 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:09 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-a87031e6-be8a-4fbd-b800-ae4b33c49730 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:09 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-a87031e6-be8a-4fbd-b800-ae4b33c49730 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:09 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-a87031e6-be8a-4fbd-b800-ae4b33c49730 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9421443b2f421298a934122c6a8b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf1fea74ef143e6b394e41e7c4ed495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:42:09 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-a87031e6-be8a-4fbd-b800-ae4b33c49730 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d" status: 200 len: 1711 microversion: 2.1 time: 0.160072 Apr 12 00:42:09 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 206/623] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:42:09 2023] GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d => generated 1711 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:42:10 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-8aa8b69c-e53b-46ba-8702-82e53fa3aaf8 req-0f193465-f1f8-45a6-9abf-6d3defa3f62a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c8e8b7-1f91-4cf5-a222-c787a186444d", "name": "network-vif-unplugged", "status": "completed", "tag": "a2a25522-be49-4ac7-9893-d030dc2d87ab"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:10 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-8aa8b69c-e53b-46ba-8702-82e53fa3aaf8 req-0f193465-f1f8-45a6-9abf-6d3defa3f62a service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:10 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-8aa8b69c-e53b-46ba-8702-82e53fa3aaf8 req-0f193465-f1f8-45a6-9abf-6d3defa3f62a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:10 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-8aa8b69c-e53b-46ba-8702-82e53fa3aaf8 req-0f193465-f1f8-45a6-9abf-6d3defa3f62a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:10 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-8aa8b69c-e53b-46ba-8702-82e53fa3aaf8 req-0f193465-f1f8-45a6-9abf-6d3defa3f62a service nova] Creating event network-vif-unplugged:a2a25522-be49-4ac7-9893-d030dc2d87ab for instance 49c8e8b7-1f91-4cf5-a222-c787a186444d on user Apr 12 00:42:10 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-8aa8b69c-e53b-46ba-8702-82e53fa3aaf8 req-0f193465-f1f8-45a6-9abf-6d3defa3f62a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032880 Apr 12 00:42:10 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 211/624] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:42:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:11 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-06cb1122-2a2f-4e00-872f-cb84457bb69b req-54750ca7-891a-49bd-8943-754a9e745671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "533174dc-5071-487b-9a2c-74cd7786af8a", "tag": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-06cb1122-2a2f-4e00-872f-cb84457bb69b req-54750ca7-891a-49bd-8943-754a9e745671 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-06cb1122-2a2f-4e00-872f-cb84457bb69b req-54750ca7-891a-49bd-8943-754a9e745671 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-06cb1122-2a2f-4e00-872f-cb84457bb69b req-54750ca7-891a-49bd-8943-754a9e745671 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:11 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-06cb1122-2a2f-4e00-872f-cb84457bb69b req-54750ca7-891a-49bd-8943-754a9e745671 service nova] Creating event network-changed:d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 for instance 533174dc-5071-487b-9a2c-74cd7786af8a on user Apr 12 00:42:11 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-06cb1122-2a2f-4e00-872f-cb84457bb69b req-54750ca7-891a-49bd-8943-754a9e745671 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037522 Apr 12 00:42:11 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 208/625] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:42:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:11 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-336796070", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "networks": [{"uuid": "2e59f1f4-986f-4135-b7f2-1d333d3017ad"}]}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:11 user devstack@n-api.service[72495]: DEBUG nova.network.neutron [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] validate_networks() for [('2e59f1f4-986f-4135-b7f2-1d333d3017ad', None, None, None, None, None)] {{(pid=72495) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:42:12 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-3a54d78f-f6a7-45ea-8481-52497cb601f4 req-8de65c02-9089-4b19-9104-f02a0c00824e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c8e8b7-1f91-4cf5-a222-c787a186444d", "name": "network-vif-plugged", "status": "completed", "tag": "a2a25522-be49-4ac7-9893-d030dc2d87ab"}, {"server_uuid": "49c8e8b7-1f91-4cf5-a222-c787a186444d", "name": "network-vif-plugged", "status": "completed", "tag": "a2a25522-be49-4ac7-9893-d030dc2d87ab"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:12 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-3a54d78f-f6a7-45ea-8481-52497cb601f4 req-8de65c02-9089-4b19-9104-f02a0c00824e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:12 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-3a54d78f-f6a7-45ea-8481-52497cb601f4 req-8de65c02-9089-4b19-9104-f02a0c00824e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:12 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-3a54d78f-f6a7-45ea-8481-52497cb601f4 req-8de65c02-9089-4b19-9104-f02a0c00824e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:12 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-3a54d78f-f6a7-45ea-8481-52497cb601f4 req-8de65c02-9089-4b19-9104-f02a0c00824e service nova] Creating event network-vif-plugged:a2a25522-be49-4ac7-9893-d030dc2d87ab for instance 49c8e8b7-1f91-4cf5-a222-c787a186444d on user Apr 12 00:42:12 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-3a54d78f-f6a7-45ea-8481-52497cb601f4 req-8de65c02-9089-4b19-9104-f02a0c00824e service nova] Creating event network-vif-plugged:a2a25522-be49-4ac7-9893-d030dc2d87ab for instance 49c8e8b7-1f91-4cf5-a222-c787a186444d on user Apr 12 00:42:12 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-3a54d78f-f6a7-45ea-8481-52497cb601f4 req-8de65c02-9089-4b19-9104-f02a0c00824e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047933 Apr 12 00:42:12 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 212/626] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:42:12 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:12 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Flavor limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:42:12 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Image limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:42:12 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Flavor pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:42:12 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Image pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:42:12 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:42:12 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:12 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:12 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:12 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:12 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:12 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:12 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Getting quotas for project f4a7eb4a2a09418eacdeaccefbf7de15. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:42:12 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Getting quotas for user 69d6e340820641729772cf35648ef785 and project f4a7eb4a2a09418eacdeaccefbf7de15. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:42:12 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Going to run 1 instances... {{(pid=72495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:42:12 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:42:12 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-093043d5-6a22-446e-bbec-84053387e265 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.980866 Apr 12 00:42:12 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 207/627] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 00:42:11 2023] POST /compute/v2.1/servers => generated 378 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 00:42:12 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-70c26653-a7ae-4bbe-adee-8a696980b3af tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:12 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-70c26653-a7ae-4bbe-adee-8a696980b3af tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:12 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-70c26653-a7ae-4bbe-adee-8a696980b3af tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:42:12 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-70c26653-a7ae-4bbe-adee-8a696980b3af tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:42:12 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-70c26653-a7ae-4bbe-adee-8a696980b3af tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:42:12 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-70c26653-a7ae-4bbe-adee-8a696980b3af tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77f09d77-815b-4e7c-905d-b27ae017c9d5" status: 200 len: 1394 microversion: 2.87 time: 0.084215 Apr 12 00:42:12 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 209/628] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:42:12 2023] GET /compute/v2.1/servers/77f09d77-815b-4e7c-905d-b27ae017c9d5 => generated 1394 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:42:14 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-16647af2-0990-425e-86a6-58ac6831efbf req-780fe5c7-e5f9-4685-b950-0e155bc37462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c8e8b7-1f91-4cf5-a222-c787a186444d", "name": "network-vif-plugged", "status": "completed", "tag": "a2a25522-be49-4ac7-9893-d030dc2d87ab"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:14 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-16647af2-0990-425e-86a6-58ac6831efbf req-780fe5c7-e5f9-4685-b950-0e155bc37462 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:14 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-16647af2-0990-425e-86a6-58ac6831efbf req-780fe5c7-e5f9-4685-b950-0e155bc37462 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:14 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-16647af2-0990-425e-86a6-58ac6831efbf req-780fe5c7-e5f9-4685-b950-0e155bc37462 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:14 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-16647af2-0990-425e-86a6-58ac6831efbf req-780fe5c7-e5f9-4685-b950-0e155bc37462 service nova] Creating event network-vif-plugged:a2a25522-be49-4ac7-9893-d030dc2d87ab for instance 49c8e8b7-1f91-4cf5-a222-c787a186444d on user Apr 12 00:42:14 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-16647af2-0990-425e-86a6-58ac6831efbf req-780fe5c7-e5f9-4685-b950-0e155bc37462 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029367 Apr 12 00:42:14 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 213/629] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:42:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:15 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-85d70fe8-361b-4270-909f-3f79484985e7 req-7017bcb0-b8b3-4ae9-8e64-8ff88c059fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f09d77-815b-4e7c-905d-b27ae017c9d5", "tag": "95181ee0-bb75-49a0-ad95-a2c225ff5f51"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-85d70fe8-361b-4270-909f-3f79484985e7 req-7017bcb0-b8b3-4ae9-8e64-8ff88c059fd1 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-85d70fe8-361b-4270-909f-3f79484985e7 req-7017bcb0-b8b3-4ae9-8e64-8ff88c059fd1 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-85d70fe8-361b-4270-909f-3f79484985e7 req-7017bcb0-b8b3-4ae9-8e64-8ff88c059fd1 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:15 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-85d70fe8-361b-4270-909f-3f79484985e7 req-7017bcb0-b8b3-4ae9-8e64-8ff88c059fd1 service nova] Creating event network-changed:95181ee0-bb75-49a0-ad95-a2c225ff5f51 for instance 77f09d77-815b-4e7c-905d-b27ae017c9d5 on user Apr 12 00:42:15 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-85d70fe8-361b-4270-909f-3f79484985e7 req-7017bcb0-b8b3-4ae9-8e64-8ff88c059fd1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041724 Apr 12 00:42:15 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 208/630] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:42:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:17 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-09971aba-3d43-4080-a011-5b322fb9598a req-c3f17607-9298-4808-91e6-bcefea9f7750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "533174dc-5071-487b-9a2c-74cd7786af8a", "name": "network-vif-plugged", "status": "completed", "tag": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:17 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-09971aba-3d43-4080-a011-5b322fb9598a req-c3f17607-9298-4808-91e6-bcefea9f7750 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:17 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-09971aba-3d43-4080-a011-5b322fb9598a req-c3f17607-9298-4808-91e6-bcefea9f7750 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:17 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-09971aba-3d43-4080-a011-5b322fb9598a req-c3f17607-9298-4808-91e6-bcefea9f7750 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:17 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-09971aba-3d43-4080-a011-5b322fb9598a req-c3f17607-9298-4808-91e6-bcefea9f7750 service nova] Creating event network-vif-plugged:d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 for instance 533174dc-5071-487b-9a2c-74cd7786af8a on user Apr 12 00:42:17 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-09971aba-3d43-4080-a011-5b322fb9598a req-c3f17607-9298-4808-91e6-bcefea9f7750 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047243 Apr 12 00:42:17 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 210/631] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:42:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:18 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-f771788b-45c2-4996-9e0a-8a45b45b822d req-504a08f6-6384-4c06-b79d-9e016f35375e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f09d77-815b-4e7c-905d-b27ae017c9d5", "name": "network-vif-plugged", "status": "completed", "tag": "95181ee0-bb75-49a0-ad95-a2c225ff5f51"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-f771788b-45c2-4996-9e0a-8a45b45b822d req-504a08f6-6384-4c06-b79d-9e016f35375e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-f771788b-45c2-4996-9e0a-8a45b45b822d req-504a08f6-6384-4c06-b79d-9e016f35375e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-f771788b-45c2-4996-9e0a-8a45b45b822d req-504a08f6-6384-4c06-b79d-9e016f35375e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:18 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-f771788b-45c2-4996-9e0a-8a45b45b822d req-504a08f6-6384-4c06-b79d-9e016f35375e service nova] Creating event network-vif-plugged:95181ee0-bb75-49a0-ad95-a2c225ff5f51 for instance 77f09d77-815b-4e7c-905d-b27ae017c9d5 on user Apr 12 00:42:18 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-f771788b-45c2-4996-9e0a-8a45b45b822d req-504a08f6-6384-4c06-b79d-9e016f35375e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047465 Apr 12 00:42:18 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 214/632] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:42:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:19 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-27a5022d-c9ce-475a-93a9-2686d400fcb7 req-bdeb8eac-cefb-4566-b3db-197d6414430d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "533174dc-5071-487b-9a2c-74cd7786af8a", "name": "network-vif-plugged", "status": "completed", "tag": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-27a5022d-c9ce-475a-93a9-2686d400fcb7 req-bdeb8eac-cefb-4566-b3db-197d6414430d service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-27a5022d-c9ce-475a-93a9-2686d400fcb7 req-bdeb8eac-cefb-4566-b3db-197d6414430d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-27a5022d-c9ce-475a-93a9-2686d400fcb7 req-bdeb8eac-cefb-4566-b3db-197d6414430d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:19 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-27a5022d-c9ce-475a-93a9-2686d400fcb7 req-bdeb8eac-cefb-4566-b3db-197d6414430d service nova] Creating event network-vif-plugged:d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 for instance 533174dc-5071-487b-9a2c-74cd7786af8a on user Apr 12 00:42:19 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-27a5022d-c9ce-475a-93a9-2686d400fcb7 req-bdeb8eac-cefb-4566-b3db-197d6414430d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029694 Apr 12 00:42:19 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 209/633] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:42:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:20 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:42:20 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-3e8dc2d6-db85-4a93-84c0-5cff5bb83f69 req-7276123f-b14d-4d8b-9b9a-c08994939cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f09d77-815b-4e7c-905d-b27ae017c9d5", "name": "network-vif-plugged", "status": "completed", "tag": "95181ee0-bb75-49a0-ad95-a2c225ff5f51"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-3e8dc2d6-db85-4a93-84c0-5cff5bb83f69 req-7276123f-b14d-4d8b-9b9a-c08994939cd7 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-3e8dc2d6-db85-4a93-84c0-5cff5bb83f69 req-7276123f-b14d-4d8b-9b9a-c08994939cd7 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-3e8dc2d6-db85-4a93-84c0-5cff5bb83f69 req-7276123f-b14d-4d8b-9b9a-c08994939cd7 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:20 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-3e8dc2d6-db85-4a93-84c0-5cff5bb83f69 req-7276123f-b14d-4d8b-9b9a-c08994939cd7 service nova] Creating event network-vif-plugged:95181ee0-bb75-49a0-ad95-a2c225ff5f51 for instance 77f09d77-815b-4e7c-905d-b27ae017c9d5 on user Apr 12 00:42:20 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-3e8dc2d6-db85-4a93-84c0-5cff5bb83f69 req-7276123f-b14d-4d8b-9b9a-c08994939cd7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058535 Apr 12 00:42:20 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 211/634] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:42:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-78421ffb-8aca-4384-971a-57cb278cdbc4 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:27 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-78421ffb-8aca-4384-971a-57cb278cdbc4 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-78421ffb-8aca-4384-971a-57cb278cdbc4 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-78421ffb-8aca-4384-971a-57cb278cdbc4 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-78421ffb-8aca-4384-971a-57cb278cdbc4 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-78421ffb-8aca-4384-971a-57cb278cdbc4 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-78421ffb-8aca-4384-971a-57cb278cdbc4 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-78421ffb-8aca-4384-971a-57cb278cdbc4 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:27 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-78421ffb-8aca-4384-971a-57cb278cdbc4 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:42:27 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-78421ffb-8aca-4384-971a-57cb278cdbc4 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 200 len: 1722 microversion: 2.1 time: 0.164986 Apr 12 00:42:27 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 215/635] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:42:27 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:42:27 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:42:27 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=8 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:42:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-dccaf3b0-6fde-4f5d-967e-7b12cb54d444 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:27 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-dccaf3b0-6fde-4f5d-967e-7b12cb54d444 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dccaf3b0-6fde-4f5d-967e-7b12cb54d444 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dccaf3b0-6fde-4f5d-967e-7b12cb54d444 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dccaf3b0-6fde-4f5d-967e-7b12cb54d444 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dccaf3b0-6fde-4f5d-967e-7b12cb54d444 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dccaf3b0-6fde-4f5d-967e-7b12cb54d444 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dccaf3b0-6fde-4f5d-967e-7b12cb54d444 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:27 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-dccaf3b0-6fde-4f5d-967e-7b12cb54d444 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:42:27 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-dccaf3b0-6fde-4f5d-967e-7b12cb54d444 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 200 len: 1722 microversion: 2.1 time: 0.148667 Apr 12 00:42:27 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 210/636] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:42:27 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:42:32 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=8 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:42:32 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:42:32 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:42:32 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-2f261179-c8ae-460a-b0d2-0d1ac6575116 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:32 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-2f261179-c8ae-460a-b0d2-0d1ac6575116 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:32 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2f261179-c8ae-460a-b0d2-0d1ac6575116 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:32 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2f261179-c8ae-460a-b0d2-0d1ac6575116 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:32 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2f261179-c8ae-460a-b0d2-0d1ac6575116 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:32 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2f261179-c8ae-460a-b0d2-0d1ac6575116 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:32 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2f261179-c8ae-460a-b0d2-0d1ac6575116 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:32 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2f261179-c8ae-460a-b0d2-0d1ac6575116 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:32 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-2f261179-c8ae-460a-b0d2-0d1ac6575116 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842535891eb4a9880f7e8859dd0de3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66fda80cb83402392e155c76ee78e1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:42:32 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-2f261179-c8ae-460a-b0d2-0d1ac6575116 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763" status: 200 len: 1533 microversion: 2.1 time: 0.211599 Apr 12 00:42:32 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 212/637] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:42:32 2023] GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763 => generated 1533 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:42:32 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-a3172356-9a60-4287-81f8-e706560666c5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:32 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-a3172356-9a60-4287-81f8-e706560666c5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2842535891eb4a9880f7e8859dd0de3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66fda80cb83402392e155c76ee78e1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:42:32 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-a3172356-9a60-4287-81f8-e706560666c5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Searching by: {'deleted': False, 'project_id': 'e66fda80cb83402392e155c76ee78e1f'} {{(pid=72496) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 12 00:42:32 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a3172356-9a60-4287-81f8-e706560666c5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:32 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a3172356-9a60-4287-81f8-e706560666c5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:32 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a3172356-9a60-4287-81f8-e706560666c5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:32 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a3172356-9a60-4287-81f8-e706560666c5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:32 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a3172356-9a60-4287-81f8-e706560666c5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:32 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-a3172356-9a60-4287-81f8-e706560666c5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:33 user devstack@n-api.service[72496]: DEBUG nova.compute.multi_cell_list [None req-a3172356-9a60-4287-81f8-e706560666c5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=72496) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 12 00:42:33 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-a3172356-9a60-4287-81f8-e706560666c5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 338 microversion: 2.1 time: 0.156661 Apr 12 00:42:33 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 216/638] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 12 00:42:32 2023] GET /compute/v2.1/servers => generated 338 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:33 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-98413fa1-272d-4096-bd3e-055099a4b66e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:33 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-98413fa1-272d-4096-bd3e-055099a4b66e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-98413fa1-272d-4096-bd3e-055099a4b66e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-98413fa1-272d-4096-bd3e-055099a4b66e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-98413fa1-272d-4096-bd3e-055099a4b66e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-98413fa1-272d-4096-bd3e-055099a4b66e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-98413fa1-272d-4096-bd3e-055099a4b66e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-98413fa1-272d-4096-bd3e-055099a4b66e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:33 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-98413fa1-272d-4096-bd3e-055099a4b66e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842535891eb4a9880f7e8859dd0de3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66fda80cb83402392e155c76ee78e1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:42:33 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-98413fa1-272d-4096-bd3e-055099a4b66e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763" status: 200 len: 1533 microversion: 2.1 time: 0.156697 Apr 12 00:42:33 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 211/639] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:42:33 2023] GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763 => generated 1533 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:42:34 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-b03dfa60-dfd1-4ce1-86ee-dfa57a3e1fc7 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:34 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-b03dfa60-dfd1-4ce1-86ee-dfa57a3e1fc7 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b03dfa60-dfd1-4ce1-86ee-dfa57a3e1fc7 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b03dfa60-dfd1-4ce1-86ee-dfa57a3e1fc7 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b03dfa60-dfd1-4ce1-86ee-dfa57a3e1fc7 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b03dfa60-dfd1-4ce1-86ee-dfa57a3e1fc7 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b03dfa60-dfd1-4ce1-86ee-dfa57a3e1fc7 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b03dfa60-dfd1-4ce1-86ee-dfa57a3e1fc7 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:34 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-b03dfa60-dfd1-4ce1-86ee-dfa57a3e1fc7 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.091043 Apr 12 00:42:34 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 213/640] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 00:42:34 2023] GET /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/os-interface => generated 283 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:34 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08438351-ef8b-444d-ad94-8d60d0c47d37"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:34 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:34 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:34 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:34 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:34 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:34 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:34 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:35 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-0a543db9-862d-42eb-9ae0-6bb96465dacb req-712f01e3-1f61-4b20-a69e-041235826613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d677c2bb-77e2-40f3-8c3a-f15c9f75276d", "tag": "f34869ea-bee8-482e-a9eb-9d9c7414a17c"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-0a543db9-862d-42eb-9ae0-6bb96465dacb req-712f01e3-1f61-4b20-a69e-041235826613 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-0a543db9-862d-42eb-9ae0-6bb96465dacb req-712f01e3-1f61-4b20-a69e-041235826613 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-0a543db9-862d-42eb-9ae0-6bb96465dacb req-712f01e3-1f61-4b20-a69e-041235826613 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:35 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-0a543db9-862d-42eb-9ae0-6bb96465dacb req-712f01e3-1f61-4b20-a69e-041235826613 service nova] Creating event network-changed:f34869ea-bee8-482e-a9eb-9d9c7414a17c for instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d on user Apr 12 00:42:35 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-0a543db9-862d-42eb-9ae0-6bb96465dacb req-712f01e3-1f61-4b20-a69e-041235826613 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033062 Apr 12 00:42:35 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 212/641] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:42:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:35 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-a2c7edc0-ca06-47fa-82ac-b4aa9cdbd566 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:35 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-a2c7edc0-ca06-47fa-82ac-b4aa9cdbd566 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a2c7edc0-ca06-47fa-82ac-b4aa9cdbd566 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a2c7edc0-ca06-47fa-82ac-b4aa9cdbd566 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a2c7edc0-ca06-47fa-82ac-b4aa9cdbd566 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a2c7edc0-ca06-47fa-82ac-b4aa9cdbd566 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a2c7edc0-ca06-47fa-82ac-b4aa9cdbd566 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a2c7edc0-ca06-47fa-82ac-b4aa9cdbd566 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:35 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-a2c7edc0-ca06-47fa-82ac-b4aa9cdbd566 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/ips" status: 200 len: 109 microversion: 2.1 time: 0.036052 Apr 12 00:42:35 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 214/642] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 00:42:35 2023] GET /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/ips => generated 109 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:35 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-f2a7156f-2beb-43ac-a2c8-eca3242f0fc5 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281050 Apr 12 00:42:35 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 217/643] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 00:42:34 2023] POST /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:36 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50b34a7a-9231-479c-9aa8-98fa4691a883"}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:36 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:36 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-681a0ed9-5eef-45fd-8e1a-6572940e2053 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:36 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-681a0ed9-5eef-45fd-8e1a-6572940e2053 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-681a0ed9-5eef-45fd-8e1a-6572940e2053 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-681a0ed9-5eef-45fd-8e1a-6572940e2053 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-681a0ed9-5eef-45fd-8e1a-6572940e2053 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-681a0ed9-5eef-45fd-8e1a-6572940e2053 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-681a0ed9-5eef-45fd-8e1a-6572940e2053 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-681a0ed9-5eef-45fd-8e1a-6572940e2053 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:36 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-681a0ed9-5eef-45fd-8e1a-6572940e2053 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5c08640a8b4472a99ea037612a1332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af94aa5f596c49c08359724ef6780f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:42:36 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-681a0ed9-5eef-45fd-8e1a-6572940e2053 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] 10.0.0.210 "GET /compute/v2.1/servers/334c6825-035f-454c-9804-00ab537f54d1" status: 200 len: 1489 microversion: 2.1 time: 0.163627 Apr 12 00:42:36 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 215/644] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:42:36 2023] GET /compute/v2.1/servers/334c6825-035f-454c-9804-00ab537f54d1 => generated 1489 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:42:36 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-56021825-622b-43f6-aa71-c2f03268dc00 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292659 Apr 12 00:42:36 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 213/645] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 00:42:36 2023] POST /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:43 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:42:43 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-b876b2db-c5bf-457b-bd60-0ce894e4e789 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50b34a7a-9231-479c-9aa8-98fa4691a883"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:43 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-b876b2db-c5bf-457b-bd60-0ce894e4e789 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:43 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=19 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:42:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b876b2db-c5bf-457b-bd60-0ce894e4e789 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b876b2db-c5bf-457b-bd60-0ce894e4e789 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b876b2db-c5bf-457b-bd60-0ce894e4e789 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b876b2db-c5bf-457b-bd60-0ce894e4e789 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b876b2db-c5bf-457b-bd60-0ce894e4e789 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b876b2db-c5bf-457b-bd60-0ce894e4e789 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:43 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:42:43 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-b876b2db-c5bf-457b-bd60-0ce894e4e789 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] HTTP exception thrown: Invalid volume: volume 50b34a7a-9231-479c-9aa8-98fa4691a883 is already attached to instances: d677c2bb-77e2-40f3-8c3a-f15c9f75276d Apr 12 00:42:43 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-b876b2db-c5bf-457b-bd60-0ce894e4e789 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Request method failure captured: Apr 12 00:42:43 user devstack@n-api.service[72496]: request: POST /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/os-volume_attachments HTTP/1.1 Apr 12 00:42:43 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:42:43 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:42:43 user devstack@n-api.service[72496]: Connection: close Apr 12 00:42:43 user devstack@n-api.service[72496]: Content-Length: 74 Apr 12 00:42:43 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:42:43 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:42:43 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:42:43 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:42:43 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNfx-yPB8Addd9whxbTRQOdN90sGir-xfc1IiR7-ECw56svld7JonHx7axp9WUmnT4KzR5TFzU-_uCRK58QPK_z1_aUm3UKF-xkJbrjTzJI02gd86EhzUOHFXsNSRIvLDd7tPEw_YsNig7FJnlwWFmOoZQqpImrudgWYdjbdfFy26et4 Apr 12 00:42:43 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:42:43 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:42:43 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:42:43 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:42:43 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:42:43 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:42:43 user devstack@n-api.service[72496]: X-Project-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:42:43 user devstack@n-api.service[72496]: X-Project-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:42:43 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:42:43 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:42:43 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b56f3c567dc84773a33d596920df727a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:42:43 user devstack@n-api.service[72496]: X-Tenant: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:42:43 user devstack@n-api.service[72496]: X-Tenant-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:42:43 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:42:43 user devstack@n-api.service[72496]: X-User: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:42:43 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:42:43 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:42:43 user devstack@n-api.service[72496]: X-User-Id: d373f582479c441e8ce9849ca694a186 Apr 12 00:42:43 user devstack@n-api.service[72496]: X-User-Name: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:42:43 user devstack@n-api.service[72496]: Apr 12 00:42:43 user devstack@n-api.service[72496]: {"volumeAttachment": {"volumeId": "50b34a7a-9231-479c-9aa8-98fa4691a883"}} Apr 12 00:42:43 user devstack@n-api.service[72496]: method: > Apr 12 00:42:43 user devstack@n-api.service[72496]: exception: Invalid volume: volume 50b34a7a-9231-479c-9aa8-98fa4691a883 is already attached to instances: d677c2bb-77e2-40f3-8c3a-f15c9f75276d Apr 12 00:42:43 user devstack@n-api.service[72496]: action_args: {'server_id': 'd677c2bb-77e2-40f3-8c3a-f15c9f75276d', 'body': {'volumeAttachment': {'volumeId': '50b34a7a-9231-479c-9aa8-98fa4691a883'}}} Apr 12 00:42:43 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 50b34a7a-9231-479c-9aa8-98fa4691a883 is already attached to instances: d677c2bb-77e2-40f3-8c3a-f15c9f75276d Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 50b34a7a-9231-479c-9aa8-98fa4691a883 is already attached to instances: d677c2bb-77e2-40f3-8c3a-f15c9f75276d Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 50b34a7a-9231-479c-9aa8-98fa4691a883 is already attached to instances: d677c2bb-77e2-40f3-8c3a-f15c9f75276d Apr 12 00:42:43 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:42:43 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-b876b2db-c5bf-457b-bd60-0ce894e4e789 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Returning 400 to user: Invalid volume: volume 50b34a7a-9231-479c-9aa8-98fa4691a883 is already attached to instances: d677c2bb-77e2-40f3-8c3a-f15c9f75276d {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:42:43 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-b876b2db-c5bf-457b-bd60-0ce894e4e789 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.134701 Apr 12 00:42:43 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 218/646] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 00:42:43 2023] POST /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/os-volume_attachments => generated 174 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:42:43 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:43 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:43 user devstack@n-api.service[72494]: DEBUG nova.objects.instance [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lazy-loading 'services' on Instance uuid d677c2bb-77e2-40f3-8c3a-f15c9f75276d {{(pid=72494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:42:43 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-a959b58a-2f84-4371-be5f-d2d97364d20f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/os-volume_attachments/50b34a7a-9231-479c-9aa8-98fa4691a883" status: 202 len: 0 microversion: 2.1 time: 0.173382 Apr 12 00:42:43 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 216/647] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 00:42:43 2023] DELETE /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/os-volume_attachments/50b34a7a-9231-479c-9aa8-98fa4691a883 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:42:43 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-85e09bc3-8a96-4ecf-ba8a-c205906e6122 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:43 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-85e09bc3-8a96-4ecf-ba8a-c205906e6122 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:43 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:42:43 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-85e09bc3-8a96-4ecf-ba8a-c205906e6122 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:43 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-85e09bc3-8a96-4ecf-ba8a-c205906e6122 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:43 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-85e09bc3-8a96-4ecf-ba8a-c205906e6122 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:43 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-85e09bc3-8a96-4ecf-ba8a-c205906e6122 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:43 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-85e09bc3-8a96-4ecf-ba8a-c205906e6122 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:43 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-85e09bc3-8a96-4ecf-ba8a-c205906e6122 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:43 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:42:43 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-85e09bc3-8a96-4ecf-ba8a-c205906e6122 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067051 Apr 12 00:42:43 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 214/648] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:42:43 2023] GET /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:44 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-7e71483b-3d63-42f0-960b-8e489d5a70d9 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:44 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-7e71483b-3d63-42f0-960b-8e489d5a70d9 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7e71483b-3d63-42f0-960b-8e489d5a70d9 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7e71483b-3d63-42f0-960b-8e489d5a70d9 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7e71483b-3d63-42f0-960b-8e489d5a70d9 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7e71483b-3d63-42f0-960b-8e489d5a70d9 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7e71483b-3d63-42f0-960b-8e489d5a70d9 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7e71483b-3d63-42f0-960b-8e489d5a70d9 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:44 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-7e71483b-3d63-42f0-960b-8e489d5a70d9 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842535891eb4a9880f7e8859dd0de3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66fda80cb83402392e155c76ee78e1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:42:44 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-7e71483b-3d63-42f0-960b-8e489d5a70d9 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763" status: 200 len: 1579 microversion: 2.1 time: 0.144326 Apr 12 00:42:44 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 219/649] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:42:44 2023] GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763 => generated 1579 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:42:46 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-8bccf7c4-9c97-4252-9e31-abcb8570dae5 req-087335ee-f261-43e2-ad13-627b4ada1d8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c57eddf0-bf85-4b87-a352-57508a728763", "tag": "d1cda216-0dbb-4296-81c2-9386697372d2"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:46 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-8bccf7c4-9c97-4252-9e31-abcb8570dae5 req-087335ee-f261-43e2-ad13-627b4ada1d8e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:46 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-8bccf7c4-9c97-4252-9e31-abcb8570dae5 req-087335ee-f261-43e2-ad13-627b4ada1d8e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:46 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-8bccf7c4-9c97-4252-9e31-abcb8570dae5 req-087335ee-f261-43e2-ad13-627b4ada1d8e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:46 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-8bccf7c4-9c97-4252-9e31-abcb8570dae5 req-087335ee-f261-43e2-ad13-627b4ada1d8e service nova] Creating event network-changed:d1cda216-0dbb-4296-81c2-9386697372d2 for instance c57eddf0-bf85-4b87-a352-57508a728763 on user Apr 12 00:42:46 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-8bccf7c4-9c97-4252-9e31-abcb8570dae5 req-087335ee-f261-43e2-ad13-627b4ada1d8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034864 Apr 12 00:42:46 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 217/650] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:42:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:47 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-41aee291-8b5f-4b77-8faf-6070f8e06079 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-629855207"}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:47 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-41aee291-8b5f-4b77-8faf-6070f8e06079 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-41aee291-8b5f-4b77-8faf-6070f8e06079 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-41aee291-8b5f-4b77-8faf-6070f8e06079 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-41aee291-8b5f-4b77-8faf-6070f8e06079 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-41aee291-8b5f-4b77-8faf-6070f8e06079 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-41aee291-8b5f-4b77-8faf-6070f8e06079 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-41aee291-8b5f-4b77-8faf-6070f8e06079 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:47 user devstack@n-api.service[72495]: INFO nova.network.security_group_api [None req-41aee291-8b5f-4b77-8faf-6070f8e06079 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Adding security group 2b9389d1-46c8-44b9-baa7-c1763e2e60a2 to port d1cda216-0dbb-4296-81c2-9386697372d2 Apr 12 00:42:48 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-41aee291-8b5f-4b77-8faf-6070f8e06079 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763/action" status: 202 len: 0 microversion: 2.1 time: 0.568855 Apr 12 00:42:48 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 215/651] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 00:42:47 2023] POST /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763/action => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:42:48 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-d50875ac-57d6-40ec-8e10-13aced45b382 req-8829a1f2-f12f-4e90-afb1-159f6ea1dbc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c57eddf0-bf85-4b87-a352-57508a728763", "tag": "d1cda216-0dbb-4296-81c2-9386697372d2"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:48 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-f5712d67-05a4-4dbf-8fcb-e6f24e47b9c4 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:48 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-f5712d67-05a4-4dbf-8fcb-e6f24e47b9c4 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:48 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f5712d67-05a4-4dbf-8fcb-e6f24e47b9c4 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:48 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d50875ac-57d6-40ec-8e10-13aced45b382 req-8829a1f2-f12f-4e90-afb1-159f6ea1dbc5 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:48 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f5712d67-05a4-4dbf-8fcb-e6f24e47b9c4 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:48 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d50875ac-57d6-40ec-8e10-13aced45b382 req-8829a1f2-f12f-4e90-afb1-159f6ea1dbc5 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:48 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f5712d67-05a4-4dbf-8fcb-e6f24e47b9c4 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:48 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d50875ac-57d6-40ec-8e10-13aced45b382 req-8829a1f2-f12f-4e90-afb1-159f6ea1dbc5 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:48 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f5712d67-05a4-4dbf-8fcb-e6f24e47b9c4 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:48 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f5712d67-05a4-4dbf-8fcb-e6f24e47b9c4 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:48 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f5712d67-05a4-4dbf-8fcb-e6f24e47b9c4 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:48 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-d50875ac-57d6-40ec-8e10-13aced45b382 req-8829a1f2-f12f-4e90-afb1-159f6ea1dbc5 service nova] Creating event network-changed:d1cda216-0dbb-4296-81c2-9386697372d2 for instance c57eddf0-bf85-4b87-a352-57508a728763 on user Apr 12 00:42:48 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-d50875ac-57d6-40ec-8e10-13aced45b382 req-8829a1f2-f12f-4e90-afb1-159f6ea1dbc5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029513 Apr 12 00:42:48 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 220/652] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:42:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:48 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-f5712d67-05a4-4dbf-8fcb-e6f24e47b9c4 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842535891eb4a9880f7e8859dd0de3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66fda80cb83402392e155c76ee78e1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:42:48 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-f5712d67-05a4-4dbf-8fcb-e6f24e47b9c4 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763" status: 200 len: 1744 microversion: 2.1 time: 0.172611 Apr 12 00:42:48 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 218/653] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:42:48 2023] GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763 => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:42:49 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:49 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:49 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-e3f82cb1-9b37-4c6c-acb2-756fc8bf3117 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763/action" status: 202 len: 0 microversion: 2.1 time: 0.105296 Apr 12 00:42:49 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 216/654] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 00:42:49 2023] POST /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:42:49 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-0039a138-d937-4b93-95b1-04e4e2e6c960 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:49 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-0039a138-d937-4b93-95b1-04e4e2e6c960 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0039a138-d937-4b93-95b1-04e4e2e6c960 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0039a138-d937-4b93-95b1-04e4e2e6c960 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0039a138-d937-4b93-95b1-04e4e2e6c960 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0039a138-d937-4b93-95b1-04e4e2e6c960 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0039a138-d937-4b93-95b1-04e4e2e6c960 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0039a138-d937-4b93-95b1-04e4e2e6c960 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:50 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-0039a138-d937-4b93-95b1-04e4e2e6c960 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842535891eb4a9880f7e8859dd0de3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66fda80cb83402392e155c76ee78e1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:42:50 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-0039a138-d937-4b93-95b1-04e4e2e6c960 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763" status: 200 len: 1746 microversion: 2.1 time: 0.179037 Apr 12 00:42:50 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 221/655] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:42:49 2023] GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763 => generated 1746 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:42:50 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-5676b917-a130-4d14-a50a-c7785795a87a req-841faecc-7af8-48c7-8239-52afb9798fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c57eddf0-bf85-4b87-a352-57508a728763", "name": "network-vif-unplugged", "status": "completed", "tag": "d1cda216-0dbb-4296-81c2-9386697372d2"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-5676b917-a130-4d14-a50a-c7785795a87a req-841faecc-7af8-48c7-8239-52afb9798fc4 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-5676b917-a130-4d14-a50a-c7785795a87a req-841faecc-7af8-48c7-8239-52afb9798fc4 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-5676b917-a130-4d14-a50a-c7785795a87a req-841faecc-7af8-48c7-8239-52afb9798fc4 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:50 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-5676b917-a130-4d14-a50a-c7785795a87a req-841faecc-7af8-48c7-8239-52afb9798fc4 service nova] Creating event network-vif-unplugged:d1cda216-0dbb-4296-81c2-9386697372d2 for instance c57eddf0-bf85-4b87-a352-57508a728763 on user Apr 12 00:42:50 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-5676b917-a130-4d14-a50a-c7785795a87a req-841faecc-7af8-48c7-8239-52afb9798fc4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029850 Apr 12 00:42:50 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 219/656] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:42:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:52 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-39edd1a4-01ac-4070-99e6-7b92f6fa358a req-92348ca6-b4a5-4bdd-bbb7-8961b9cd1b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c57eddf0-bf85-4b87-a352-57508a728763", "name": "network-vif-plugged", "status": "completed", "tag": "d1cda216-0dbb-4296-81c2-9386697372d2"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-39edd1a4-01ac-4070-99e6-7b92f6fa358a req-92348ca6-b4a5-4bdd-bbb7-8961b9cd1b27 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-39edd1a4-01ac-4070-99e6-7b92f6fa358a req-92348ca6-b4a5-4bdd-bbb7-8961b9cd1b27 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-39edd1a4-01ac-4070-99e6-7b92f6fa358a req-92348ca6-b4a5-4bdd-bbb7-8961b9cd1b27 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:52 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-39edd1a4-01ac-4070-99e6-7b92f6fa358a req-92348ca6-b4a5-4bdd-bbb7-8961b9cd1b27 service nova] Creating event network-vif-plugged:d1cda216-0dbb-4296-81c2-9386697372d2 for instance c57eddf0-bf85-4b87-a352-57508a728763 on user Apr 12 00:42:52 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-39edd1a4-01ac-4070-99e6-7b92f6fa358a req-92348ca6-b4a5-4bdd-bbb7-8961b9cd1b27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055911 Apr 12 00:42:52 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 217/657] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:42:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:55 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-2176a703-30df-453c-804a-081d9fd81633 req-4fb60f22-c8f0-4c47-b329-7a893a174852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c57eddf0-bf85-4b87-a352-57508a728763", "name": "network-vif-plugged", "status": "completed", "tag": "d1cda216-0dbb-4296-81c2-9386697372d2"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:55 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2176a703-30df-453c-804a-081d9fd81633 req-4fb60f22-c8f0-4c47-b329-7a893a174852 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:55 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2176a703-30df-453c-804a-081d9fd81633 req-4fb60f22-c8f0-4c47-b329-7a893a174852 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:55 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2176a703-30df-453c-804a-081d9fd81633 req-4fb60f22-c8f0-4c47-b329-7a893a174852 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:55 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-2176a703-30df-453c-804a-081d9fd81633 req-4fb60f22-c8f0-4c47-b329-7a893a174852 service nova] Creating event network-vif-plugged:d1cda216-0dbb-4296-81c2-9386697372d2 for instance c57eddf0-bf85-4b87-a352-57508a728763 on user Apr 12 00:42:55 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-2176a703-30df-453c-804a-081d9fd81633 req-4fb60f22-c8f0-4c47-b329-7a893a174852 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060578 Apr 12 00:42:55 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 222/658] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:42:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:57 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-bd7d3253-c92f-470a-8e29-72db97228d7b req-c90fec84-012e-4b52-b793-ddec37c43092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c57eddf0-bf85-4b87-a352-57508a728763", "name": "network-vif-plugged", "status": "completed", "tag": "d1cda216-0dbb-4296-81c2-9386697372d2"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:42:57 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-bd7d3253-c92f-470a-8e29-72db97228d7b req-c90fec84-012e-4b52-b793-ddec37c43092 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:57 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-bd7d3253-c92f-470a-8e29-72db97228d7b req-c90fec84-012e-4b52-b793-ddec37c43092 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:57 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-bd7d3253-c92f-470a-8e29-72db97228d7b req-c90fec84-012e-4b52-b793-ddec37c43092 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:57 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-bd7d3253-c92f-470a-8e29-72db97228d7b req-c90fec84-012e-4b52-b793-ddec37c43092 service nova] Creating event network-vif-plugged:d1cda216-0dbb-4296-81c2-9386697372d2 for instance c57eddf0-bf85-4b87-a352-57508a728763 on user Apr 12 00:42:57 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-bd7d3253-c92f-470a-8e29-72db97228d7b req-c90fec84-012e-4b52-b793-ddec37c43092 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032282 Apr 12 00:42:57 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 220/659] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:42:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:42:57 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-b94f579b-8ab2-41a1-8e4a-65e198a35501 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:57 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-b94f579b-8ab2-41a1-8e4a-65e198a35501 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:57 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b94f579b-8ab2-41a1-8e4a-65e198a35501 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:57 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b94f579b-8ab2-41a1-8e4a-65e198a35501 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:57 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b94f579b-8ab2-41a1-8e4a-65e198a35501 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:57 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b94f579b-8ab2-41a1-8e4a-65e198a35501 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:57 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b94f579b-8ab2-41a1-8e4a-65e198a35501 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:57 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b94f579b-8ab2-41a1-8e4a-65e198a35501 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:57 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-b94f579b-8ab2-41a1-8e4a-65e198a35501 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:42:57 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-b94f579b-8ab2-41a1-8e4a-65e198a35501 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/533174dc-5071-487b-9a2c-74cd7786af8a" status: 200 len: 1442 microversion: 2.1 time: 0.249323 Apr 12 00:42:57 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 218/660] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:42:57 2023] GET /compute/v2.1/servers/533174dc-5071-487b-9a2c-74cd7786af8a => generated 1442 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:42:59 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-91701a8a-131b-423a-94e1-7a635b9cc673 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:42:59 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-91701a8a-131b-423a-94e1-7a635b9cc673 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:42:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-91701a8a-131b-423a-94e1-7a635b9cc673 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-91701a8a-131b-423a-94e1-7a635b9cc673 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-91701a8a-131b-423a-94e1-7a635b9cc673 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-91701a8a-131b-423a-94e1-7a635b9cc673 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:42:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-91701a8a-131b-423a-94e1-7a635b9cc673 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:42:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-91701a8a-131b-423a-94e1-7a635b9cc673 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:42:59 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-91701a8a-131b-423a-94e1-7a635b9cc673 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9421443b2f421298a934122c6a8b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf1fea74ef143e6b394e41e7c4ed495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:42:59 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-91701a8a-131b-423a-94e1-7a635b9cc673 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d" status: 200 len: 1717 microversion: 2.1 time: 0.175182 Apr 12 00:42:59 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 223/661] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:42:59 2023] GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d => generated 1717 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:43:02 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-4e52b75f-0ed0-40c9-9e41-3429d9a303e5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:02 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-4e52b75f-0ed0-40c9-9e41-3429d9a303e5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:43:03 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=19 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:43:03 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4e52b75f-0ed0-40c9-9e41-3429d9a303e5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:03 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4e52b75f-0ed0-40c9-9e41-3429d9a303e5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:03 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4e52b75f-0ed0-40c9-9e41-3429d9a303e5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:03 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4e52b75f-0ed0-40c9-9e41-3429d9a303e5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:03 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4e52b75f-0ed0-40c9-9e41-3429d9a303e5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:03 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4e52b75f-0ed0-40c9-9e41-3429d9a303e5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:03 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=42,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:43:03 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-4e52b75f-0ed0-40c9-9e41-3429d9a303e5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:43:03 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-4e52b75f-0ed0-40c9-9e41-3429d9a303e5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:43:03 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-4e52b75f-0ed0-40c9-9e41-3429d9a303e5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:43:03 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-4e52b75f-0ed0-40c9-9e41-3429d9a303e5 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77f09d77-815b-4e7c-905d-b27ae017c9d5" status: 200 len: 1690 microversion: 2.87 time: 0.174672 Apr 12 00:43:03 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 221/662] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:43:02 2023] GET /compute/v2.1/servers/77f09d77-815b-4e7c-905d-b27ae017c9d5 => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:43:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:27 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:43:27 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=9 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:43:27 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:43:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:27 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Going to try to terminate instance {{(pid=72495) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:43:27 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-c04d7acc-7092-4b8e-9202-1f0218110f34 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 204 len: 0 microversion: 2.1 time: 0.136891 Apr 12 00:43:27 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 219/663] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:43:27 2023] DELETE /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:43:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-f9224aae-ff10-469a-a231-983bbc667d6e tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:27 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-f9224aae-ff10-469a-a231-983bbc667d6e tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:43:27 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=11 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:43:27 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=27 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:43:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f9224aae-ff10-469a-a231-983bbc667d6e tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f9224aae-ff10-469a-a231-983bbc667d6e tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f9224aae-ff10-469a-a231-983bbc667d6e tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f9224aae-ff10-469a-a231-983bbc667d6e tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f9224aae-ff10-469a-a231-983bbc667d6e tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f9224aae-ff10-469a-a231-983bbc667d6e tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:27 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-f9224aae-ff10-469a-a231-983bbc667d6e tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:43:27 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-f9224aae-ff10-469a-a231-983bbc667d6e tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 200 len: 1728 microversion: 2.1 time: 0.190372 Apr 12 00:43:27 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 224/664] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:43:27 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 1728 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:43:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-bc5cec38-753a-444b-812a-c37c1f626091 req-8c9e3b11-5016-4e67-9cb5-d55066e19422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe6d6bc-65a6-469a-89a0-7e4c51620b14", "name": "network-vif-unplugged", "status": "completed", "tag": "b99b54c2-0b21-42ea-91d0-087aa230da7e"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:43:27 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=5 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:43:27 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=3 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:43:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-bc5cec38-753a-444b-812a-c37c1f626091 req-8c9e3b11-5016-4e67-9cb5-d55066e19422 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-bc5cec38-753a-444b-812a-c37c1f626091 req-8c9e3b11-5016-4e67-9cb5-d55066e19422 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-bc5cec38-753a-444b-812a-c37c1f626091 req-8c9e3b11-5016-4e67-9cb5-d55066e19422 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:27 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-bc5cec38-753a-444b-812a-c37c1f626091 req-8c9e3b11-5016-4e67-9cb5-d55066e19422 service nova] Creating event network-vif-unplugged:b99b54c2-0b21-42ea-91d0-087aa230da7e for instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 on user Apr 12 00:43:27 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-bc5cec38-753a-444b-812a-c37c1f626091 req-8c9e3b11-5016-4e67-9cb5-d55066e19422 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036907 Apr 12 00:43:27 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 222/665] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:43:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:43:29 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-01a1dbcd-0dca-4606-9187-c3924896efbe req-fd54e822-a251-48f3-bae4-7679debe7c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe6d6bc-65a6-469a-89a0-7e4c51620b14", "name": "network-vif-deleted", "tag": "b99b54c2-0b21-42ea-91d0-087aa230da7e"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:43:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-01a1dbcd-0dca-4606-9187-c3924896efbe req-fd54e822-a251-48f3-bae4-7679debe7c32 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-01a1dbcd-0dca-4606-9187-c3924896efbe req-fd54e822-a251-48f3-bae4-7679debe7c32 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-01a1dbcd-0dca-4606-9187-c3924896efbe req-fd54e822-a251-48f3-bae4-7679debe7c32 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:29 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-01a1dbcd-0dca-4606-9187-c3924896efbe req-fd54e822-a251-48f3-bae4-7679debe7c32 service nova] Creating event network-vif-deleted:b99b54c2-0b21-42ea-91d0-087aa230da7e for instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 on user Apr 12 00:43:29 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-01a1dbcd-0dca-4606-9187-c3924896efbe req-fd54e822-a251-48f3-bae4-7679debe7c32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036485 Apr 12 00:43:29 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 220/666] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:43:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:43:29 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-830d50fe-4c94-4dab-bc2c-6c65d1196683 req-8c123e09-7032-4b59-b0f8-b743cbed35b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbe6d6bc-65a6-469a-89a0-7e4c51620b14", "name": "network-vif-plugged", "status": "completed", "tag": "b99b54c2-0b21-42ea-91d0-087aa230da7e"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:43:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-830d50fe-4c94-4dab-bc2c-6c65d1196683 req-8c123e09-7032-4b59-b0f8-b743cbed35b3 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-830d50fe-4c94-4dab-bc2c-6c65d1196683 req-8c123e09-7032-4b59-b0f8-b743cbed35b3 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-830d50fe-4c94-4dab-bc2c-6c65d1196683 req-8c123e09-7032-4b59-b0f8-b743cbed35b3 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:29 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-830d50fe-4c94-4dab-bc2c-6c65d1196683 req-8c123e09-7032-4b59-b0f8-b743cbed35b3 service nova] Creating event network-vif-plugged:b99b54c2-0b21-42ea-91d0-087aa230da7e for instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 on user Apr 12 00:43:29 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-830d50fe-4c94-4dab-bc2c-6c65d1196683 req-8c123e09-7032-4b59-b0f8-b743cbed35b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028173 Apr 12 00:43:29 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 225/667] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:43:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:43:33 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-926851d5-cf9d-4038-beae-2de59f535d4d tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:33 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-926851d5-cf9d-4038-beae-2de59f535d4d tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:43:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-926851d5-cf9d-4038-beae-2de59f535d4d tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-926851d5-cf9d-4038-beae-2de59f535d4d tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-926851d5-cf9d-4038-beae-2de59f535d4d tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-926851d5-cf9d-4038-beae-2de59f535d4d tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-926851d5-cf9d-4038-beae-2de59f535d4d tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-926851d5-cf9d-4038-beae-2de59f535d4d tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:33 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-926851d5-cf9d-4038-beae-2de59f535d4d tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041925 Apr 12 00:43:33 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 223/668] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:43:33 2023] GET /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:43:33 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:33 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:43:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:33 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Going to try to terminate instance {{(pid=72495) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:43:34 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-7b098e40-b539-4225-abdc-cfb92be82c23 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d" status: 204 len: 0 microversion: 2.1 time: 0.112294 Apr 12 00:43:34 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 221/669] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:43:33 2023] DELETE /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:43:34 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-2aa41887-0a80-4ab8-ab56-e39c9103921f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:34 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-2aa41887-0a80-4ab8-ab56-e39c9103921f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:43:34 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2aa41887-0a80-4ab8-ab56-e39c9103921f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:34 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2aa41887-0a80-4ab8-ab56-e39c9103921f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:34 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2aa41887-0a80-4ab8-ab56-e39c9103921f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:34 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2aa41887-0a80-4ab8-ab56-e39c9103921f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:34 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2aa41887-0a80-4ab8-ab56-e39c9103921f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:34 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2aa41887-0a80-4ab8-ab56-e39c9103921f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:34 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-2aa41887-0a80-4ab8-ab56-e39c9103921f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373f582479c441e8ce9849ca694a186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f3c567dc84773a33d596920df727a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:43:34 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-2aa41887-0a80-4ab8-ab56-e39c9103921f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d" status: 200 len: 1670 microversion: 2.1 time: 0.163769 Apr 12 00:43:34 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 226/670] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:43:34 2023] GET /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:43:34 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-0039b294-388b-497e-b15c-2b814bc93c07 req-db64f08a-5520-4913-aeff-50f9ce39d90e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d677c2bb-77e2-40f3-8c3a-f15c9f75276d", "name": "network-vif-unplugged", "status": "completed", "tag": "f34869ea-bee8-482e-a9eb-9d9c7414a17c"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:43:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-0039b294-388b-497e-b15c-2b814bc93c07 req-db64f08a-5520-4913-aeff-50f9ce39d90e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-0039b294-388b-497e-b15c-2b814bc93c07 req-db64f08a-5520-4913-aeff-50f9ce39d90e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-0039b294-388b-497e-b15c-2b814bc93c07 req-db64f08a-5520-4913-aeff-50f9ce39d90e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:34 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-0039b294-388b-497e-b15c-2b814bc93c07 req-db64f08a-5520-4913-aeff-50f9ce39d90e service nova] Creating event network-vif-unplugged:f34869ea-bee8-482e-a9eb-9d9c7414a17c for instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d on user Apr 12 00:43:34 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-0039b294-388b-497e-b15c-2b814bc93c07 req-db64f08a-5520-4913-aeff-50f9ce39d90e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031749 Apr 12 00:43:34 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 224/671] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:43:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:43:36 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-48a9e765-e543-41e7-b64a-8f35af540b29 req-4ba6d6c9-8f34-4525-b075-49977fa76128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d677c2bb-77e2-40f3-8c3a-f15c9f75276d", "name": "network-vif-plugged", "status": "completed", "tag": "f34869ea-bee8-482e-a9eb-9d9c7414a17c"}, {"server_uuid": "d677c2bb-77e2-40f3-8c3a-f15c9f75276d", "name": "network-vif-deleted", "tag": "f34869ea-bee8-482e-a9eb-9d9c7414a17c"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:43:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-48a9e765-e543-41e7-b64a-8f35af540b29 req-4ba6d6c9-8f34-4525-b075-49977fa76128 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-48a9e765-e543-41e7-b64a-8f35af540b29 req-4ba6d6c9-8f34-4525-b075-49977fa76128 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-48a9e765-e543-41e7-b64a-8f35af540b29 req-4ba6d6c9-8f34-4525-b075-49977fa76128 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:36 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-48a9e765-e543-41e7-b64a-8f35af540b29 req-4ba6d6c9-8f34-4525-b075-49977fa76128 service nova] Creating event network-vif-plugged:f34869ea-bee8-482e-a9eb-9d9c7414a17c for instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d on user Apr 12 00:43:36 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-48a9e765-e543-41e7-b64a-8f35af540b29 req-4ba6d6c9-8f34-4525-b075-49977fa76128 service nova] Creating event network-vif-deleted:f34869ea-bee8-482e-a9eb-9d9c7414a17c for instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d on user Apr 12 00:43:36 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-48a9e765-e543-41e7-b64a-8f35af540b29 req-4ba6d6c9-8f34-4525-b075-49977fa76128 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033140 Apr 12 00:43:36 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 222/672] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:43:36 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:43:38 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1eb43ca0-b670-4380-a916-3b9305fdcb5f"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:43:38 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:43:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:38 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-08452789-6299-472b-8496-b1c8cf3dec89 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] 10.0.0.210 "POST /compute/v2.1/servers/334c6825-035f-454c-9804-00ab537f54d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282521 Apr 12 00:43:38 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 227/673] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 00:43:38 2023] POST /compute/v2.1/servers/334c6825-035f-454c-9804-00ab537f54d1/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:43:40 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-93997472-1dfd-421e-99a4-dbdfb35ba7c1 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:40 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-93997472-1dfd-421e-99a4-dbdfb35ba7c1 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:43:40 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-93997472-1dfd-421e-99a4-dbdfb35ba7c1 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:40 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-93997472-1dfd-421e-99a4-dbdfb35ba7c1 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:40 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-93997472-1dfd-421e-99a4-dbdfb35ba7c1 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:40 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-93997472-1dfd-421e-99a4-dbdfb35ba7c1 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:40 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-93997472-1dfd-421e-99a4-dbdfb35ba7c1 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:40 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-93997472-1dfd-421e-99a4-dbdfb35ba7c1 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:40 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-93997472-1dfd-421e-99a4-dbdfb35ba7c1 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842535891eb4a9880f7e8859dd0de3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66fda80cb83402392e155c76ee78e1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:43:40 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-93997472-1dfd-421e-99a4-dbdfb35ba7c1 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763" status: 200 len: 1744 microversion: 2.1 time: 0.158029 Apr 12 00:43:40 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 225/674] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:43:40 2023] GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:43:44 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:44 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:43:44 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:44 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:45 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Going to try to terminate instance {{(pid=72495) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:43:45 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-9f84a91d-ebdb-44bd-aa34-8132eec68b4e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/334c6825-035f-454c-9804-00ab537f54d1" status: 204 len: 0 microversion: 2.1 time: 0.118446 Apr 12 00:43:45 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 223/675] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:43:44 2023] DELETE /compute/v2.1/servers/334c6825-035f-454c-9804-00ab537f54d1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:43:45 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-38b34885-d54a-4814-ab68-ca036241704e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:45 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-38b34885-d54a-4814-ab68-ca036241704e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:43:45 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-38b34885-d54a-4814-ab68-ca036241704e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:45 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-38b34885-d54a-4814-ab68-ca036241704e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:45 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-38b34885-d54a-4814-ab68-ca036241704e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:45 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-38b34885-d54a-4814-ab68-ca036241704e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:45 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-38b34885-d54a-4814-ab68-ca036241704e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:45 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-38b34885-d54a-4814-ab68-ca036241704e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:45 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-38b34885-d54a-4814-ab68-ca036241704e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d5c08640a8b4472a99ea037612a1332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af94aa5f596c49c08359724ef6780f94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:43:45 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-38b34885-d54a-4814-ab68-ca036241704e tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] 10.0.0.210 "GET /compute/v2.1/servers/334c6825-035f-454c-9804-00ab537f54d1" status: 200 len: 1541 microversion: 2.1 time: 0.168064 Apr 12 00:43:45 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 228/676] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:43:45 2023] GET /compute/v2.1/servers/334c6825-035f-454c-9804-00ab537f54d1 => generated 1541 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:43:45 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-b2626217-c429-4554-a919-a695189fe7e6 req-79dee78c-f09d-41d7-8434-34b876ce21bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "334c6825-035f-454c-9804-00ab537f54d1", "name": "network-vif-unplugged", "status": "completed", "tag": "8c84814e-5562-4740-8e7a-565fbeefa36f"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:43:45 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-b2626217-c429-4554-a919-a695189fe7e6 req-79dee78c-f09d-41d7-8434-34b876ce21bd service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:45 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-b2626217-c429-4554-a919-a695189fe7e6 req-79dee78c-f09d-41d7-8434-34b876ce21bd service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:45 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-b2626217-c429-4554-a919-a695189fe7e6 req-79dee78c-f09d-41d7-8434-34b876ce21bd service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:45 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-b2626217-c429-4554-a919-a695189fe7e6 req-79dee78c-f09d-41d7-8434-34b876ce21bd service nova] Creating event network-vif-unplugged:8c84814e-5562-4740-8e7a-565fbeefa36f for instance 334c6825-035f-454c-9804-00ab537f54d1 on user Apr 12 00:43:45 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-b2626217-c429-4554-a919-a695189fe7e6 req-79dee78c-f09d-41d7-8434-34b876ce21bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030082 Apr 12 00:43:45 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 226/677] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:43:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:43:46 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-68ee2102-ab23-4b8e-ae37-5c4613b9363a req-c0961b07-336f-4b9e-90b1-d9966c87cdfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "334c6825-035f-454c-9804-00ab537f54d1", "name": "network-vif-deleted", "tag": "8c84814e-5562-4740-8e7a-565fbeefa36f"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:43:46 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-68ee2102-ab23-4b8e-ae37-5c4613b9363a req-c0961b07-336f-4b9e-90b1-d9966c87cdfd service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:46 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-68ee2102-ab23-4b8e-ae37-5c4613b9363a req-c0961b07-336f-4b9e-90b1-d9966c87cdfd service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:46 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-68ee2102-ab23-4b8e-ae37-5c4613b9363a req-c0961b07-336f-4b9e-90b1-d9966c87cdfd service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:46 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-68ee2102-ab23-4b8e-ae37-5c4613b9363a req-c0961b07-336f-4b9e-90b1-d9966c87cdfd service nova] Creating event network-vif-deleted:8c84814e-5562-4740-8e7a-565fbeefa36f for instance 334c6825-035f-454c-9804-00ab537f54d1 on user Apr 12 00:43:46 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-68ee2102-ab23-4b8e-ae37-5c4613b9363a req-c0961b07-336f-4b9e-90b1-d9966c87cdfd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031014 Apr 12 00:43:46 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 224/678] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:43:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:43:47 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-397a3314-c686-4b59-9e31-9b34479c34b6 req-621ed7c7-87fd-402f-bf97-ba3c4a3c488b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "334c6825-035f-454c-9804-00ab537f54d1", "name": "network-vif-plugged", "status": "completed", "tag": "8c84814e-5562-4740-8e7a-565fbeefa36f"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:43:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-397a3314-c686-4b59-9e31-9b34479c34b6 req-621ed7c7-87fd-402f-bf97-ba3c4a3c488b service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-397a3314-c686-4b59-9e31-9b34479c34b6 req-621ed7c7-87fd-402f-bf97-ba3c4a3c488b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-397a3314-c686-4b59-9e31-9b34479c34b6 req-621ed7c7-87fd-402f-bf97-ba3c4a3c488b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:47 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-397a3314-c686-4b59-9e31-9b34479c34b6 req-621ed7c7-87fd-402f-bf97-ba3c4a3c488b service nova] Creating event network-vif-plugged:8c84814e-5562-4740-8e7a-565fbeefa36f for instance 334c6825-035f-454c-9804-00ab537f54d1 on user Apr 12 00:43:47 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-397a3314-c686-4b59-9e31-9b34479c34b6 req-621ed7c7-87fd-402f-bf97-ba3c4a3c488b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049948 Apr 12 00:43:47 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 229/679] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:43:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:43:58 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-0ca4b6f1-33df-4f48-9dac-1167db61fb42 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:58 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-0ca4b6f1-33df-4f48-9dac-1167db61fb42 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:43:58 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=10 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:43:58 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=18 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:43:58 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0ca4b6f1-33df-4f48-9dac-1167db61fb42 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:58 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0ca4b6f1-33df-4f48-9dac-1167db61fb42 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:58 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0ca4b6f1-33df-4f48-9dac-1167db61fb42 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:58 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0ca4b6f1-33df-4f48-9dac-1167db61fb42 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:58 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0ca4b6f1-33df-4f48-9dac-1167db61fb42 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:58 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0ca4b6f1-33df-4f48-9dac-1167db61fb42 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:58 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-0ca4b6f1-33df-4f48-9dac-1167db61fb42 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:43:58 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-0ca4b6f1-33df-4f48-9dac-1167db61fb42 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/533174dc-5071-487b-9a2c-74cd7786af8a" status: 200 len: 1442 microversion: 2.1 time: 0.167158 Apr 12 00:43:58 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 227/680] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:43:57 2023] GET /compute/v2.1/servers/533174dc-5071-487b-9a2c-74cd7786af8a => generated 1442 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:43:59 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-63015114-1daa-463f-bb85-3f9061f55918 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:43:59 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-63015114-1daa-463f-bb85-3f9061f55918 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:43:59 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=3 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:43:59 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:43:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-63015114-1daa-463f-bb85-3f9061f55918 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-63015114-1daa-463f-bb85-3f9061f55918 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-63015114-1daa-463f-bb85-3f9061f55918 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-63015114-1daa-463f-bb85-3f9061f55918 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-63015114-1daa-463f-bb85-3f9061f55918 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-63015114-1daa-463f-bb85-3f9061f55918 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:59 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-63015114-1daa-463f-bb85-3f9061f55918 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.088381 Apr 12 00:43:59 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 225/681] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 00:43:59 2023] GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d/os-interface => generated 283 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:43:59 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=12 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:43:59 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:43:59 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-6e42ea02-da9b-43ac-b844-362265197197 req-e8c89ba1-eb1b-4a6f-9549-25c335bbd8dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "533174dc-5071-487b-9a2c-74cd7786af8a", "tag": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:43:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-6e42ea02-da9b-43ac-b844-362265197197 req-e8c89ba1-eb1b-4a6f-9549-25c335bbd8dc service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:43:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-6e42ea02-da9b-43ac-b844-362265197197 req-e8c89ba1-eb1b-4a6f-9549-25c335bbd8dc service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:43:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-6e42ea02-da9b-43ac-b844-362265197197 req-e8c89ba1-eb1b-4a6f-9549-25c335bbd8dc service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:43:59 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-6e42ea02-da9b-43ac-b844-362265197197 req-e8c89ba1-eb1b-4a6f-9549-25c335bbd8dc service nova] Creating event network-changed:d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 for instance 533174dc-5071-487b-9a2c-74cd7786af8a on user Apr 12 00:43:59 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-6e42ea02-da9b-43ac-b844-362265197197 req-e8c89ba1-eb1b-4a6f-9549-25c335bbd8dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037922 Apr 12 00:43:59 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 230/682] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:43:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:00 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-638dd61b-1238-45d9-b2b5-6ca9d72c99a3 req-71eceb39-aa61-4ece-a81a-8d330bfbc16c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49c8e8b7-1f91-4cf5-a222-c787a186444d", "tag": "a2a25522-be49-4ac7-9893-d030dc2d87ab"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:44:00 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-638dd61b-1238-45d9-b2b5-6ca9d72c99a3 req-71eceb39-aa61-4ece-a81a-8d330bfbc16c service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:00 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-638dd61b-1238-45d9-b2b5-6ca9d72c99a3 req-71eceb39-aa61-4ece-a81a-8d330bfbc16c service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:00 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-638dd61b-1238-45d9-b2b5-6ca9d72c99a3 req-71eceb39-aa61-4ece-a81a-8d330bfbc16c service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:00 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-638dd61b-1238-45d9-b2b5-6ca9d72c99a3 req-71eceb39-aa61-4ece-a81a-8d330bfbc16c service nova] Creating event network-changed:a2a25522-be49-4ac7-9893-d030dc2d87ab for instance 49c8e8b7-1f91-4cf5-a222-c787a186444d on user Apr 12 00:44:00 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-638dd61b-1238-45d9-b2b5-6ca9d72c99a3 req-71eceb39-aa61-4ece-a81a-8d330bfbc16c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028853 Apr 12 00:44:00 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 228/683] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:44:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:00 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:00 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:44:00 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:00 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:00 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:00 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:00 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:00 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:00 user devstack@n-api.service[72495]: DEBUG nova.objects.instance [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lazy-loading 'services' on Instance uuid 49c8e8b7-1f91-4cf5-a222-c787a186444d {{(pid=72495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:44:00 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-eafcbb58-7a76-4a7f-bafe-f6e162351c89 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d/os-volume_attachments/41a82ec2-4e13-4a4b-980f-66064c4ec035" status: 202 len: 0 microversion: 2.1 time: 0.201665 Apr 12 00:44:00 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 226/684] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 00:44:00 2023] DELETE /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d/os-volume_attachments/41a82ec2-4e13-4a4b-980f-66064c4ec035 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:44:00 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-5b6b525d-a12c-4c4b-814a-17eadea1e0a0 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:00 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-5b6b525d-a12c-4c4b-814a-17eadea1e0a0 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:44:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-5b6b525d-a12c-4c4b-814a-17eadea1e0a0 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-5b6b525d-a12c-4c4b-814a-17eadea1e0a0 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-5b6b525d-a12c-4c4b-814a-17eadea1e0a0 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-5b6b525d-a12c-4c4b-814a-17eadea1e0a0 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-5b6b525d-a12c-4c4b-814a-17eadea1e0a0 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:00 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-5b6b525d-a12c-4c4b-814a-17eadea1e0a0 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:00 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-5b6b525d-a12c-4c4b-814a-17eadea1e0a0 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049536 Apr 12 00:44:00 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 231/685] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:44:00 2023] GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:02 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-e46c63bb-e5fc-4d7c-a5b2-bb6c1ace1458 req-746de28e-8edd-4a8b-a156-85bc1c319a8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49c8e8b7-1f91-4cf5-a222-c787a186444d", "tag": "a2a25522-be49-4ac7-9893-d030dc2d87ab"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:44:02 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-e46c63bb-e5fc-4d7c-a5b2-bb6c1ace1458 req-746de28e-8edd-4a8b-a156-85bc1c319a8e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:02 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-e46c63bb-e5fc-4d7c-a5b2-bb6c1ace1458 req-746de28e-8edd-4a8b-a156-85bc1c319a8e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:02 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-e46c63bb-e5fc-4d7c-a5b2-bb6c1ace1458 req-746de28e-8edd-4a8b-a156-85bc1c319a8e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:02 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-e46c63bb-e5fc-4d7c-a5b2-bb6c1ace1458 req-746de28e-8edd-4a8b-a156-85bc1c319a8e service nova] Creating event network-changed:a2a25522-be49-4ac7-9893-d030dc2d87ab for instance 49c8e8b7-1f91-4cf5-a222-c787a186444d on user Apr 12 00:44:02 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-e46c63bb-e5fc-4d7c-a5b2-bb6c1ace1458 req-746de28e-8edd-4a8b-a156-85bc1c319a8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032519 Apr 12 00:44:02 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 229/686] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:44:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:03 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1798298972"}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:44:03 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:44:03 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:03 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:03 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:03 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:03 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:03 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:03 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2006086526", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1592613584", "security_groups": [{"name": "tempest-secgroup-smoke-1090038461"}], "block_device_mapping_v2": [{"uuid": "f4d47a21-91ca-485b-8642-8e74639fdb62", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "159bca51-de37-4d87-9af5-ec97816a869c"}]}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:44:03 user devstack@n-api.service[72496]: DEBUG nova.network.neutron [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] validate_networks() for [('159bca51-de37-4d87-9af5-ec97816a869c', None, None, None, None, None)] {{(pid=72496) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:44:04 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-6de1b6de-120f-493c-a015-6100250ec2d2 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "POST /compute/v2.1/servers/77f09d77-815b-4e7c-905d-b27ae017c9d5/action" status: 202 len: 52 microversion: 2.87 time: 0.822372 Apr 12 00:44:04 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 227/687] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 00:44:03 2023] POST /compute/v2.1/servers/77f09d77-815b-4e7c-905d-b27ae017c9d5/action => generated 52 bytes in 825 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 12 00:44:04 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flavor limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:44:04 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Image limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:44:04 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Flavor pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:44:04 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Image pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:44:04 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:44:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:04 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting quotas for project e38a98bf1d964ee6bd2d0d05e97a283a. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:44:04 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Getting quotas for user c479f6ae2f0d40908be9b07717ca3509 and project e38a98bf1d964ee6bd2d0d05e97a283a. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:44:04 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Going to run 1 instances... {{(pid=72496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:44:04 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f4d47a21-91ca-485b-8642-8e74639fdb62',volume_size=None,volume_type=None)] {{(pid=72496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:44:04 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-7f9058b7-80c9-4a0d-9671-39e7d7c2aa9e tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.692396 Apr 12 00:44:04 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 232/688] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:44:03 2023] POST /compute/v2.1/servers => generated 404 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:44:04 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-6cf6dcdb-8c0d-484a-ad60-3a1de4fef4ae tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:04 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-6cf6dcdb-8c0d-484a-ad60-3a1de4fef4ae tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:44:04 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-6cf6dcdb-8c0d-484a-ad60-3a1de4fef4ae tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:44:04 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-6cf6dcdb-8c0d-484a-ad60-3a1de4fef4ae tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5d898c2-8548-4b32-829e-6afa11e1985f" status: 200 len: 1090 microversion: 2.1 time: 0.067442 Apr 12 00:44:04 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 230/689] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:44:04 2023] GET /compute/v2.1/servers/e5d898c2-8548-4b32-829e-6afa11e1985f => generated 1090 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:44:07 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-3ddc116e-6dca-4672-9b45-6eff3fad5ca5 req-d0ec3f56-4432-4072-87ad-daa872f6ca43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d898c2-8548-4b32-829e-6afa11e1985f", "tag": "6578df38-44dd-4f35-943f-b2da72deea5f"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:44:07 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3ddc116e-6dca-4672-9b45-6eff3fad5ca5 req-d0ec3f56-4432-4072-87ad-daa872f6ca43 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:07 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3ddc116e-6dca-4672-9b45-6eff3fad5ca5 req-d0ec3f56-4432-4072-87ad-daa872f6ca43 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:07 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3ddc116e-6dca-4672-9b45-6eff3fad5ca5 req-d0ec3f56-4432-4072-87ad-daa872f6ca43 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:07 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-3ddc116e-6dca-4672-9b45-6eff3fad5ca5 req-d0ec3f56-4432-4072-87ad-daa872f6ca43 service nova] Creating event network-changed:6578df38-44dd-4f35-943f-b2da72deea5f for instance e5d898c2-8548-4b32-829e-6afa11e1985f on user Apr 12 00:44:07 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-3ddc116e-6dca-4672-9b45-6eff3fad5ca5 req-d0ec3f56-4432-4072-87ad-daa872f6ca43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052209 Apr 12 00:44:07 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 228/690] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:44:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:44:09 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-7cedb0db-affc-47aa-b88a-7be8c69809ee tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:09 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-7cedb0db-affc-47aa-b88a-7be8c69809ee tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:44:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7cedb0db-affc-47aa-b88a-7be8c69809ee tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7cedb0db-affc-47aa-b88a-7be8c69809ee tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7cedb0db-affc-47aa-b88a-7be8c69809ee tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7cedb0db-affc-47aa-b88a-7be8c69809ee tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7cedb0db-affc-47aa-b88a-7be8c69809ee tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7cedb0db-affc-47aa-b88a-7be8c69809ee tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:09 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-7cedb0db-affc-47aa-b88a-7be8c69809ee tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:44:09 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-7cedb0db-affc-47aa-b88a-7be8c69809ee tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:44:09 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-7cedb0db-affc-47aa-b88a-7be8c69809ee tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:44:09 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-7cedb0db-affc-47aa-b88a-7be8c69809ee tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77f09d77-815b-4e7c-905d-b27ae017c9d5" status: 200 len: 1690 microversion: 2.87 time: 0.153639 Apr 12 00:44:09 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 233/691] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:44:09 2023] GET /compute/v2.1/servers/77f09d77-815b-4e7c-905d-b27ae017c9d5 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:44:13 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-b05f0a8a-0d2e-427d-ab33-51b0052a8360 req-02937e18-a203-4ba9-a650-54e082857a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d898c2-8548-4b32-829e-6afa11e1985f", "name": "network-vif-plugged", "status": "completed", "tag": "6578df38-44dd-4f35-943f-b2da72deea5f"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:44:13 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=10 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:44:13 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-b05f0a8a-0d2e-427d-ab33-51b0052a8360 req-02937e18-a203-4ba9-a650-54e082857a5e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:13 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-b05f0a8a-0d2e-427d-ab33-51b0052a8360 req-02937e18-a203-4ba9-a650-54e082857a5e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:13 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-b05f0a8a-0d2e-427d-ab33-51b0052a8360 req-02937e18-a203-4ba9-a650-54e082857a5e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:13 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-b05f0a8a-0d2e-427d-ab33-51b0052a8360 req-02937e18-a203-4ba9-a650-54e082857a5e service nova] Creating event network-vif-plugged:6578df38-44dd-4f35-943f-b2da72deea5f for instance e5d898c2-8548-4b32-829e-6afa11e1985f on user Apr 12 00:44:13 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-b05f0a8a-0d2e-427d-ab33-51b0052a8360 req-02937e18-a203-4ba9-a650-54e082857a5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037876 Apr 12 00:44:13 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 231/692] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:44:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:15 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-d58834d4-46d7-4913-9562-f080e1eb47d3 req-ba1f9677-03af-4f8c-bc05-b490ceb2378e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d898c2-8548-4b32-829e-6afa11e1985f", "name": "network-vif-plugged", "status": "completed", "tag": "6578df38-44dd-4f35-943f-b2da72deea5f"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:44:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d58834d4-46d7-4913-9562-f080e1eb47d3 req-ba1f9677-03af-4f8c-bc05-b490ceb2378e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d58834d4-46d7-4913-9562-f080e1eb47d3 req-ba1f9677-03af-4f8c-bc05-b490ceb2378e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d58834d4-46d7-4913-9562-f080e1eb47d3 req-ba1f9677-03af-4f8c-bc05-b490ceb2378e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:15 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-d58834d4-46d7-4913-9562-f080e1eb47d3 req-ba1f9677-03af-4f8c-bc05-b490ceb2378e service nova] Creating event network-vif-plugged:6578df38-44dd-4f35-943f-b2da72deea5f for instance e5d898c2-8548-4b32-829e-6afa11e1985f on user Apr 12 00:44:15 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-d58834d4-46d7-4913-9562-f080e1eb47d3 req-ba1f9677-03af-4f8c-bc05-b490ceb2378e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032028 Apr 12 00:44:15 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 229/693] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:44:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:17 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-eb2fd69d-d617-432b-914b-41950d072819 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:17 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-eb2fd69d-d617-432b-914b-41950d072819 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:44:17 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:44:17 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:44:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-eb2fd69d-d617-432b-914b-41950d072819 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-eb2fd69d-d617-432b-914b-41950d072819 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-eb2fd69d-d617-432b-914b-41950d072819 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-eb2fd69d-d617-432b-914b-41950d072819 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-eb2fd69d-d617-432b-914b-41950d072819 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-eb2fd69d-d617-432b-914b-41950d072819 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:17 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-eb2fd69d-d617-432b-914b-41950d072819 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] HTTP exception thrown: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:44:17 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-eb2fd69d-d617-432b-914b-41950d072819 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Request method failure captured: Apr 12 00:44:17 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 HTTP/1.1 Apr 12 00:44:17 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:44:17 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:44:17 user devstack@n-api.service[72496]: Connection: close Apr 12 00:44:17 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:44:17 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:44:17 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:44:17 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:44:17 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:44:17 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNft8pxUfRov3VWMJsz3neTVP7vjPZrPoG_D_RpQWIM-EEGVf8w5xREov2D3rG8pVUGFFc4iIpAW0aRk2Z5TmADpnstC41AikbDOkY4nppdui0mYCGWq3s8swIvjZVz3SyGIqiVTX7Hr0WxRb2aVDp1_7Es2G3Qsunn_AD4oFLvHyF9g Apr 12 00:44:17 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:44:17 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:44:17 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:44:17 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:44:17 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:44:17 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:44:17 user devstack@n-api.service[72496]: X-Project-Id: d8ba626fdf264b879099a89097845153 Apr 12 00:44:17 user devstack@n-api.service[72496]: X-Project-Name: tempest-ServerActionsTestJSON-674156571 Apr 12 00:44:17 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:44:17 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:44:17 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8ba626fdf264b879099a89097845153"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d8ba626fdf264b879099a89097845153"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8ba626fdf264b879099a89097845153"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:44:17 user devstack@n-api.service[72496]: X-Tenant: tempest-ServerActionsTestJSON-674156571 Apr 12 00:44:17 user devstack@n-api.service[72496]: X-Tenant-Id: d8ba626fdf264b879099a89097845153 Apr 12 00:44:17 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-ServerActionsTestJSON-674156571 Apr 12 00:44:17 user devstack@n-api.service[72496]: X-User: tempest-ServerActionsTestJSON-674156571-project-member Apr 12 00:44:17 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:44:17 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:44:17 user devstack@n-api.service[72496]: X-User-Id: d658147b4def4d12a16381d4c19357e3 Apr 12 00:44:17 user devstack@n-api.service[72496]: X-User-Name: tempest-ServerActionsTestJSON-674156571-project-member Apr 12 00:44:17 user devstack@n-api.service[72496]: method: > Apr 12 00:44:17 user devstack@n-api.service[72496]: exception: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:44:17 user devstack@n-api.service[72496]: action_args: {'id': 'dbe6d6bc-65a6-469a-89a0-7e4c51620b14'} Apr 12 00:44:17 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:44:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:44:17 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-eb2fd69d-d617-432b-914b-41950d072819 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Returning 404 to user: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:44:17 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-eb2fd69d-d617-432b-914b-41950d072819 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 404 len: 111 microversion: 2.1 time: 0.041355 Apr 12 00:44:17 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 234/694] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:44:17 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:44:17 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:44:17 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-28f9b687-7cf7-4e9c-89e8-807a70d81731 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:17 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-28f9b687-7cf7-4e9c-89e8-807a70d81731 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:44:17 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-28f9b687-7cf7-4e9c-89e8-807a70d81731 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:17 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-28f9b687-7cf7-4e9c-89e8-807a70d81731 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:17 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-28f9b687-7cf7-4e9c-89e8-807a70d81731 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:17 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-28f9b687-7cf7-4e9c-89e8-807a70d81731 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:17 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-28f9b687-7cf7-4e9c-89e8-807a70d81731 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:17 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-28f9b687-7cf7-4e9c-89e8-807a70d81731 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:17 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-28f9b687-7cf7-4e9c-89e8-807a70d81731 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] HTTP exception thrown: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:44:17 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-28f9b687-7cf7-4e9c-89e8-807a70d81731 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Request method failure captured: Apr 12 00:44:17 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/os-volume_attachments HTTP/1.1 Apr 12 00:44:17 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:44:17 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:44:17 user devstack@n-api.service[72494]: Connection: close Apr 12 00:44:17 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:44:17 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:44:17 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:44:17 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:44:17 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:44:17 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNft8pxUfRov3VWMJsz3neTVP7vjPZrPoG_D_RpQWIM-EEGVf8w5xREov2D3rG8pVUGFFc4iIpAW0aRk2Z5TmADpnstC41AikbDOkY4nppdui0mYCGWq3s8swIvjZVz3SyGIqiVTX7Hr0WxRb2aVDp1_7Es2G3Qsunn_AD4oFLvHyF9g Apr 12 00:44:17 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:44:17 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:44:17 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:44:17 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:44:17 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:44:17 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:44:17 user devstack@n-api.service[72494]: X-Project-Id: d8ba626fdf264b879099a89097845153 Apr 12 00:44:17 user devstack@n-api.service[72494]: X-Project-Name: tempest-ServerActionsTestJSON-674156571 Apr 12 00:44:17 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:44:17 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:44:17 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8ba626fdf264b879099a89097845153"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d8ba626fdf264b879099a89097845153"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8ba626fdf264b879099a89097845153"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:44:17 user devstack@n-api.service[72494]: X-Tenant: tempest-ServerActionsTestJSON-674156571 Apr 12 00:44:17 user devstack@n-api.service[72494]: X-Tenant-Id: d8ba626fdf264b879099a89097845153 Apr 12 00:44:17 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-ServerActionsTestJSON-674156571 Apr 12 00:44:17 user devstack@n-api.service[72494]: X-User: tempest-ServerActionsTestJSON-674156571-project-member Apr 12 00:44:17 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:44:17 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:44:17 user devstack@n-api.service[72494]: X-User-Id: d658147b4def4d12a16381d4c19357e3 Apr 12 00:44:17 user devstack@n-api.service[72494]: X-User-Name: tempest-ServerActionsTestJSON-674156571-project-member Apr 12 00:44:17 user devstack@n-api.service[72494]: method: > Apr 12 00:44:17 user devstack@n-api.service[72494]: exception: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:44:17 user devstack@n-api.service[72494]: action_args: {'server_id': 'dbe6d6bc-65a6-469a-89a0-7e4c51620b14'} Apr 12 00:44:17 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:44:17 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:44:17 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-28f9b687-7cf7-4e9c-89e8-807a70d81731 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Returning 404 to user: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:44:17 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-28f9b687-7cf7-4e9c-89e8-807a70d81731 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040430 Apr 12 00:44:17 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 232/695] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:44:17 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:44:18 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-463a05ac-4ac7-4bca-a428-c187ddc2bf5a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:18 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-463a05ac-4ac7-4bca-a428-c187ddc2bf5a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:44:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-463a05ac-4ac7-4bca-a428-c187ddc2bf5a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-463a05ac-4ac7-4bca-a428-c187ddc2bf5a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-463a05ac-4ac7-4bca-a428-c187ddc2bf5a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-463a05ac-4ac7-4bca-a428-c187ddc2bf5a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-463a05ac-4ac7-4bca-a428-c187ddc2bf5a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-463a05ac-4ac7-4bca-a428-c187ddc2bf5a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:18 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-463a05ac-4ac7-4bca-a428-c187ddc2bf5a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] HTTP exception thrown: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:44:18 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-463a05ac-4ac7-4bca-a428-c187ddc2bf5a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Request method failure captured: Apr 12 00:44:18 user devstack@n-api.service[72495]: request: GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 HTTP/1.1 Apr 12 00:44:18 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:44:18 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:44:18 user devstack@n-api.service[72495]: Connection: close Apr 12 00:44:18 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 00:44:18 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:44:18 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:44:18 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:44:18 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:44:18 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNft8pxUfRov3VWMJsz3neTVP7vjPZrPoG_D_RpQWIM-EEGVf8w5xREov2D3rG8pVUGFFc4iIpAW0aRk2Z5TmADpnstC41AikbDOkY4nppdui0mYCGWq3s8swIvjZVz3SyGIqiVTX7Hr0WxRb2aVDp1_7Es2G3Qsunn_AD4oFLvHyF9g Apr 12 00:44:18 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:44:18 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:44:18 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:44:18 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:44:18 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:44:18 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:44:18 user devstack@n-api.service[72495]: X-Project-Id: d8ba626fdf264b879099a89097845153 Apr 12 00:44:18 user devstack@n-api.service[72495]: X-Project-Name: tempest-ServerActionsTestJSON-674156571 Apr 12 00:44:18 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:44:18 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:44:18 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8ba626fdf264b879099a89097845153"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d8ba626fdf264b879099a89097845153"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8ba626fdf264b879099a89097845153"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:44:18 user devstack@n-api.service[72495]: X-Tenant: tempest-ServerActionsTestJSON-674156571 Apr 12 00:44:18 user devstack@n-api.service[72495]: X-Tenant-Id: d8ba626fdf264b879099a89097845153 Apr 12 00:44:18 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-ServerActionsTestJSON-674156571 Apr 12 00:44:18 user devstack@n-api.service[72495]: X-User: tempest-ServerActionsTestJSON-674156571-project-member Apr 12 00:44:18 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:44:18 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:44:18 user devstack@n-api.service[72495]: X-User-Id: d658147b4def4d12a16381d4c19357e3 Apr 12 00:44:18 user devstack@n-api.service[72495]: X-User-Name: tempest-ServerActionsTestJSON-674156571-project-member Apr 12 00:44:18 user devstack@n-api.service[72495]: method: > Apr 12 00:44:18 user devstack@n-api.service[72495]: exception: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:44:18 user devstack@n-api.service[72495]: action_args: {'id': 'dbe6d6bc-65a6-469a-89a0-7e4c51620b14'} Apr 12 00:44:18 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:44:18 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:44:18 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-463a05ac-4ac7-4bca-a428-c187ddc2bf5a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Returning 404 to user: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:44:18 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-463a05ac-4ac7-4bca-a428-c187ddc2bf5a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 404 len: 111 microversion: 2.1 time: 0.032423 Apr 12 00:44:18 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 230/696] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:44:17 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:44:18 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1988870830", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "networks": [{"uuid": "bb566dde-458e-4ead-a04b-6dbdb540007d"}], "security_groups": [{"name": "tempest-securitygroup--1163846610"}], "key_name": "tempest-keypair-1452487550", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:44:18 user devstack@n-api.service[72496]: DEBUG nova.network.neutron [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] validate_networks() for [('bb566dde-458e-4ead-a04b-6dbdb540007d', None, None, None, None, None)] {{(pid=72496) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:44:18 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:44:18 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:44:18 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:44:18 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:44:18 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:44:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:18 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting quotas for project d8ba626fdf264b879099a89097845153. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:44:18 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting quotas for user d658147b4def4d12a16381d4c19357e3 and project d8ba626fdf264b879099a89097845153. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:44:18 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Going to run 1 instances... {{(pid=72496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:44:18 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:44:18 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-b9b0230f-3728-458a-9b8e-81ed90b9203a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.563220 Apr 12 00:44:18 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 235/697] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:44:18 2023] POST /compute/v2.1/servers => generated 404 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:44:18 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-d5bf0da0-e1eb-4b1d-b0e3-f5ddf9b742b7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:18 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-d5bf0da0-e1eb-4b1d-b0e3-f5ddf9b742b7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:44:18 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-d5bf0da0-e1eb-4b1d-b0e3-f5ddf9b742b7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:44:18 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-d5bf0da0-e1eb-4b1d-b0e3-f5ddf9b742b7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84861eef-6d59-448b-b6b7-eb8dd8e47b30" status: 200 len: 1233 microversion: 2.1 time: 0.066286 Apr 12 00:44:18 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 233/698] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:44:18 2023] GET /compute/v2.1/servers/84861eef-6d59-448b-b6b7-eb8dd8e47b30 => generated 1233 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:44:21 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-2f05bea9-4401-41bc-8fe7-49ea64bdc6c2 req-0b5c4d23-bb4f-47fa-bcfd-c03317ff7d10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84861eef-6d59-448b-b6b7-eb8dd8e47b30", "tag": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:44:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-2f05bea9-4401-41bc-8fe7-49ea64bdc6c2 req-0b5c4d23-bb4f-47fa-bcfd-c03317ff7d10 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-2f05bea9-4401-41bc-8fe7-49ea64bdc6c2 req-0b5c4d23-bb4f-47fa-bcfd-c03317ff7d10 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-2f05bea9-4401-41bc-8fe7-49ea64bdc6c2 req-0b5c4d23-bb4f-47fa-bcfd-c03317ff7d10 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:21 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-2f05bea9-4401-41bc-8fe7-49ea64bdc6c2 req-0b5c4d23-bb4f-47fa-bcfd-c03317ff7d10 service nova] Creating event network-changed:df061f79-7574-4b3c-9cf4-2b0e61c5efc1 for instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30 on user Apr 12 00:44:21 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-2f05bea9-4401-41bc-8fe7-49ea64bdc6c2 req-0b5c4d23-bb4f-47fa-bcfd-c03317ff7d10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031765 Apr 12 00:44:21 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 231/699] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:44:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:23 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-22b830dc-81cf-4190-b2bd-b622f2d0376e req-df931e45-ba4b-42fb-97e2-edcf835e96cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84861eef-6d59-448b-b6b7-eb8dd8e47b30", "name": "network-vif-plugged", "status": "completed", "tag": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:44:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-22b830dc-81cf-4190-b2bd-b622f2d0376e req-df931e45-ba4b-42fb-97e2-edcf835e96cc service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-22b830dc-81cf-4190-b2bd-b622f2d0376e req-df931e45-ba4b-42fb-97e2-edcf835e96cc service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-22b830dc-81cf-4190-b2bd-b622f2d0376e req-df931e45-ba4b-42fb-97e2-edcf835e96cc service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:23 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-22b830dc-81cf-4190-b2bd-b622f2d0376e req-df931e45-ba4b-42fb-97e2-edcf835e96cc service nova] Creating event network-vif-plugged:df061f79-7574-4b3c-9cf4-2b0e61c5efc1 for instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30 on user Apr 12 00:44:23 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-22b830dc-81cf-4190-b2bd-b622f2d0376e req-df931e45-ba4b-42fb-97e2-edcf835e96cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060749 Apr 12 00:44:23 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 236/700] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:44:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:24 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-73545f5b-9e67-4a87-8788-10573ca88833 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:24 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-73545f5b-9e67-4a87-8788-10573ca88833 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:44:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-73545f5b-9e67-4a87-8788-10573ca88833 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-73545f5b-9e67-4a87-8788-10573ca88833 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-73545f5b-9e67-4a87-8788-10573ca88833 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-73545f5b-9e67-4a87-8788-10573ca88833 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-73545f5b-9e67-4a87-8788-10573ca88833 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-73545f5b-9e67-4a87-8788-10573ca88833 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:24 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-73545f5b-9e67-4a87-8788-10573ca88833 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] HTTP exception thrown: Instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d could not be found. Apr 12 00:44:24 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-73545f5b-9e67-4a87-8788-10573ca88833 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Request method failure captured: Apr 12 00:44:24 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d HTTP/1.1 Apr 12 00:44:24 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:44:24 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:44:24 user devstack@n-api.service[72494]: Connection: close Apr 12 00:44:24 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:44:24 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:44:24 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:44:24 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:44:24 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:44:24 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNfx-yPB8Addd9whxbTRQOdN90sGir-xfc1IiR7-ECw56svld7JonHx7axp9WUmnT4KzR5TFzU-_uCRK58QPK_z1_aUm3UKF-xkJbrjTzJI02gd86EhzUOHFXsNSRIvLDd7tPEw_YsNig7FJnlwWFmOoZQqpImrudgWYdjbdfFy26et4 Apr 12 00:44:24 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:44:24 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:44:24 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:44:24 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:44:24 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:44:24 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:44:24 user devstack@n-api.service[72494]: X-Project-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:44:24 user devstack@n-api.service[72494]: X-Project-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:44:24 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:44:24 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:44:24 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b56f3c567dc84773a33d596920df727a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:44:24 user devstack@n-api.service[72494]: X-Tenant: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:44:24 user devstack@n-api.service[72494]: X-Tenant-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:44:24 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:44:24 user devstack@n-api.service[72494]: X-User: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:44:24 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:44:24 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:44:24 user devstack@n-api.service[72494]: X-User-Id: d373f582479c441e8ce9849ca694a186 Apr 12 00:44:24 user devstack@n-api.service[72494]: X-User-Name: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:44:24 user devstack@n-api.service[72494]: method: > Apr 12 00:44:24 user devstack@n-api.service[72494]: exception: Instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d could not be found. Apr 12 00:44:24 user devstack@n-api.service[72494]: action_args: {'id': 'd677c2bb-77e2-40f3-8c3a-f15c9f75276d'} Apr 12 00:44:24 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d could not be found. Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d could not be found. Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d could not be found. Apr 12 00:44:24 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:44:24 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-73545f5b-9e67-4a87-8788-10573ca88833 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Returning 404 to user: Instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:44:24 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-73545f5b-9e67-4a87-8788-10573ca88833 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d" status: 404 len: 111 microversion: 2.1 time: 0.031457 Apr 12 00:44:24 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 234/701] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:44:24 2023] GET /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:44:24 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-86e80e84-16ab-42f4-82cd-2259f996f4cb tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '.version_select at 0x7f7cd454bf40>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:24 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-86e80e84-16ab-42f4-82cd-2259f996f4cb tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-289836934" status: 202 len: 0 microversion: 2.1 time: 0.031639 Apr 12 00:44:24 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 232/702] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 00:44:24 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-289836934 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:44:25 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-acc9c2b2-c837-4337-b796-5bae8045cdcf tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Action: 'create', calling method: .version_select at 0x7f7cd4523910>, body: {"keypair": {"name": "tempest-keypair-1507461507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWoOc9Cok7OCIn0o1ylURWNrc9FLpoUoG9E4RofMhXE1/xPXUgETixtUirX7kgwq6Uda1/WtQ6DD3WITd65+7Csn8D/LyAnrosTmYHnnOaA6qNkD8YhaIhIQMvIVTLvXA=="}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:44:25 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-acc9c2b2-c837-4337-b796-5bae8045cdcf tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Getting quotas for project b56f3c567dc84773a33d596920df727a. Resources: {'key_pairs'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:44:25 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-acc9c2b2-c837-4337-b796-5bae8045cdcf tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Getting quotas for user d373f582479c441e8ce9849ca694a186 and project b56f3c567dc84773a33d596920df727a. Resources: {'key_pairs'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:44:25 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-acc9c2b2-c837-4337-b796-5bae8045cdcf tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050820 Apr 12 00:44:25 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 237/703] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 00:44:25 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:25 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-052b1caf-8263-44a6-86c3-6bcd95d1abbc req-8c13c782-d456-4f58-a798-7348d8742a70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84861eef-6d59-448b-b6b7-eb8dd8e47b30", "name": "network-vif-plugged", "status": "completed", "tag": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:44:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-052b1caf-8263-44a6-86c3-6bcd95d1abbc req-8c13c782-d456-4f58-a798-7348d8742a70 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-052b1caf-8263-44a6-86c3-6bcd95d1abbc req-8c13c782-d456-4f58-a798-7348d8742a70 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-052b1caf-8263-44a6-86c3-6bcd95d1abbc req-8c13c782-d456-4f58-a798-7348d8742a70 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:25 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-052b1caf-8263-44a6-86c3-6bcd95d1abbc req-8c13c782-d456-4f58-a798-7348d8742a70 service nova] Creating event network-vif-plugged:df061f79-7574-4b3c-9cf4-2b0e61c5efc1 for instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30 on user Apr 12 00:44:25 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-052b1caf-8263-44a6-86c3-6bcd95d1abbc req-8c13c782-d456-4f58-a798-7348d8742a70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046867 Apr 12 00:44:25 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 235/704] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:44:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:26 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-76911330", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "df248eb3-f39c-4a81-aca0-6c2d01f6d2b1"}], "security_groups": [{"name": "tempest-securitygroup--77757525"}], "key_name": "tempest-keypair-1507461507", "user_data": "}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:44:26 user devstack@n-api.service[72495]: DEBUG nova.network.neutron [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] validate_networks() for [('df248eb3-f39c-4a81-aca0-6c2d01f6d2b1', None, None, None, None, None)] {{(pid=72495) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:44:27 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Flavor limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:44:27 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Image limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:44:27 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Flavor pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:44:27 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Image pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:44:27 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:44:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:27 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:27 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Getting quotas for project b56f3c567dc84773a33d596920df727a. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:44:27 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Getting quotas for user d373f582479c441e8ce9849ca694a186 and project b56f3c567dc84773a33d596920df727a. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:44:27 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Going to run 1 instances... {{(pid=72495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:44:27 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:44:27 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-f55e7722-7278-4e6f-8b11-bfb8ffb7bc59 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 398 microversion: 2.1 time: 0.962121 Apr 12 00:44:27 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 233/705] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:44:26 2023] POST /compute/v2.1/servers => generated 398 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:44:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-1d14e4ff-a743-4514-a079-d06a6d1433ff tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:27 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-1d14e4ff-a743-4514-a079-d06a6d1433ff tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:44:27 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-1d14e4ff-a743-4514-a079-d06a6d1433ff tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373f582479c441e8ce9849ca694a186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f3c567dc84773a33d596920df727a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:44:27 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-1d14e4ff-a743-4514-a079-d06a6d1433ff tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7" status: 200 len: 1234 microversion: 2.1 time: 0.070673 Apr 12 00:44:27 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 238/706] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:44:27 2023] GET /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7 => generated 1234 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:44:30 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:44:30 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-69257287-564e-48b3-8969-82f706b1b7f4 req-af882603-8450-4ea0-8474-ece2acc7a19d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a346a131-2502-457a-acb8-8f903a7b87a7", "tag": "9457e7d7-925c-4488-bb2d-c3019a663c42"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:44:30 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=23 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:44:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-69257287-564e-48b3-8969-82f706b1b7f4 req-af882603-8450-4ea0-8474-ece2acc7a19d service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-69257287-564e-48b3-8969-82f706b1b7f4 req-af882603-8450-4ea0-8474-ece2acc7a19d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-69257287-564e-48b3-8969-82f706b1b7f4 req-af882603-8450-4ea0-8474-ece2acc7a19d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:30 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-69257287-564e-48b3-8969-82f706b1b7f4 req-af882603-8450-4ea0-8474-ece2acc7a19d service nova] Creating event network-changed:9457e7d7-925c-4488-bb2d-c3019a663c42 for instance a346a131-2502-457a-acb8-8f903a7b87a7 on user Apr 12 00:44:30 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-69257287-564e-48b3-8969-82f706b1b7f4 req-af882603-8450-4ea0-8474-ece2acc7a19d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035120 Apr 12 00:44:30 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 236/707] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:44:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:32 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-8bbdcb6b-8dc2-4cb4-9fd5-f946fc702a13 req-c41c3071-b5c2-4f61-be46-e43a46e1d6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a346a131-2502-457a-acb8-8f903a7b87a7", "name": "network-vif-plugged", "status": "completed", "tag": "9457e7d7-925c-4488-bb2d-c3019a663c42"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:44:32 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:44:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8bbdcb6b-8dc2-4cb4-9fd5-f946fc702a13 req-c41c3071-b5c2-4f61-be46-e43a46e1d6c2 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8bbdcb6b-8dc2-4cb4-9fd5-f946fc702a13 req-c41c3071-b5c2-4f61-be46-e43a46e1d6c2 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8bbdcb6b-8dc2-4cb4-9fd5-f946fc702a13 req-c41c3071-b5c2-4f61-be46-e43a46e1d6c2 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:32 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:44:32 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-8bbdcb6b-8dc2-4cb4-9fd5-f946fc702a13 req-c41c3071-b5c2-4f61-be46-e43a46e1d6c2 service nova] Creating event network-vif-plugged:9457e7d7-925c-4488-bb2d-c3019a663c42 for instance a346a131-2502-457a-acb8-8f903a7b87a7 on user Apr 12 00:44:32 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-8bbdcb6b-8dc2-4cb4-9fd5-f946fc702a13 req-c41c3071-b5c2-4f61-be46-e43a46e1d6c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040253 Apr 12 00:44:32 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 234/708] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:44:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:34 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-8566626c-b367-4da3-8f2e-9abf95e58476 req-3963d559-b5ee-476b-958f-f9c1b4ff3e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a346a131-2502-457a-acb8-8f903a7b87a7", "name": "network-vif-plugged", "status": "completed", "tag": "9457e7d7-925c-4488-bb2d-c3019a663c42"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:44:34 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:44:34 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=22 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:44:34 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=7 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:44:34 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-8566626c-b367-4da3-8f2e-9abf95e58476 req-3963d559-b5ee-476b-958f-f9c1b4ff3e32 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:34 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-8566626c-b367-4da3-8f2e-9abf95e58476 req-3963d559-b5ee-476b-958f-f9c1b4ff3e32 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:34 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-8566626c-b367-4da3-8f2e-9abf95e58476 req-3963d559-b5ee-476b-958f-f9c1b4ff3e32 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:34 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-8566626c-b367-4da3-8f2e-9abf95e58476 req-3963d559-b5ee-476b-958f-f9c1b4ff3e32 service nova] Creating event network-vif-plugged:9457e7d7-925c-4488-bb2d-c3019a663c42 for instance a346a131-2502-457a-acb8-8f903a7b87a7 on user Apr 12 00:44:34 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-8566626c-b367-4da3-8f2e-9abf95e58476 req-3963d559-b5ee-476b-958f-f9c1b4ff3e32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052961 Apr 12 00:44:34 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 239/709] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:44:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:35 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-a1a06646-a7a7-437b-993c-61e66fbb85d9 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:35 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-a1a06646-a7a7-437b-993c-61e66fbb85d9 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:44:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a1a06646-a7a7-437b-993c-61e66fbb85d9 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a1a06646-a7a7-437b-993c-61e66fbb85d9 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a1a06646-a7a7-437b-993c-61e66fbb85d9 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a1a06646-a7a7-437b-993c-61e66fbb85d9 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a1a06646-a7a7-437b-993c-61e66fbb85d9 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a1a06646-a7a7-437b-993c-61e66fbb85d9 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:35 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-a1a06646-a7a7-437b-993c-61e66fbb85d9 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] HTTP exception thrown: Instance 334c6825-035f-454c-9804-00ab537f54d1 could not be found. Apr 12 00:44:35 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-a1a06646-a7a7-437b-993c-61e66fbb85d9 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Request method failure captured: Apr 12 00:44:35 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/334c6825-035f-454c-9804-00ab537f54d1 HTTP/1.1 Apr 12 00:44:35 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:44:35 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:44:35 user devstack@n-api.service[72494]: Connection: close Apr 12 00:44:35 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:44:35 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:44:35 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:44:35 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:44:35 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:44:35 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNf5J8I3fRh27iTUx7sPAjFQW4RWDStkRHgWxbQwElGWznm4-kh3K8gOFYpVFFmf_jo8yag3S-jILjsMNnlM4SbOuVYBXAVUaoha0U0ApwgZahD_u2nPD2DpEqApH0-2wlqHdERwJe6PTH_FGzoAlwACatwwjE2_CqFCX_rTtRW_Ss20 Apr 12 00:44:35 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:44:35 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:44:35 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:44:35 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:44:35 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:44:35 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:44:35 user devstack@n-api.service[72494]: X-Project-Id: af94aa5f596c49c08359724ef6780f94 Apr 12 00:44:35 user devstack@n-api.service[72494]: X-Project-Name: tempest-DeleteServersTestJSON-1834816505 Apr 12 00:44:35 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:44:35 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:44:35 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af94aa5f596c49c08359724ef6780f94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/af94aa5f596c49c08359724ef6780f94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af94aa5f596c49c08359724ef6780f94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:44:35 user devstack@n-api.service[72494]: X-Tenant: tempest-DeleteServersTestJSON-1834816505 Apr 12 00:44:35 user devstack@n-api.service[72494]: X-Tenant-Id: af94aa5f596c49c08359724ef6780f94 Apr 12 00:44:35 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-DeleteServersTestJSON-1834816505 Apr 12 00:44:35 user devstack@n-api.service[72494]: X-User: tempest-DeleteServersTestJSON-1834816505-project-member Apr 12 00:44:35 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:44:35 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:44:35 user devstack@n-api.service[72494]: X-User-Id: 6d5c08640a8b4472a99ea037612a1332 Apr 12 00:44:35 user devstack@n-api.service[72494]: X-User-Name: tempest-DeleteServersTestJSON-1834816505-project-member Apr 12 00:44:35 user devstack@n-api.service[72494]: method: > Apr 12 00:44:35 user devstack@n-api.service[72494]: exception: Instance 334c6825-035f-454c-9804-00ab537f54d1 could not be found. Apr 12 00:44:35 user devstack@n-api.service[72494]: action_args: {'id': '334c6825-035f-454c-9804-00ab537f54d1'} Apr 12 00:44:35 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 334c6825-035f-454c-9804-00ab537f54d1 could not be found. Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 334c6825-035f-454c-9804-00ab537f54d1 could not be found. Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 334c6825-035f-454c-9804-00ab537f54d1 could not be found. Apr 12 00:44:35 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:44:35 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-a1a06646-a7a7-437b-993c-61e66fbb85d9 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Returning 404 to user: Instance 334c6825-035f-454c-9804-00ab537f54d1 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:44:35 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-a1a06646-a7a7-437b-993c-61e66fbb85d9 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] 10.0.0.210 "GET /compute/v2.1/servers/334c6825-035f-454c-9804-00ab537f54d1" status: 404 len: 111 microversion: 2.1 time: 0.036976 Apr 12 00:44:35 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 237/710] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:44:35 2023] GET /compute/v2.1/servers/334c6825-035f-454c-9804-00ab537f54d1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:44:35 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-e2f89480-6431-47ec-93d6-2f16776fe2d2 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:35 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-e2f89480-6431-47ec-93d6-2f16776fe2d2 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:44:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e2f89480-6431-47ec-93d6-2f16776fe2d2 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e2f89480-6431-47ec-93d6-2f16776fe2d2 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e2f89480-6431-47ec-93d6-2f16776fe2d2 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e2f89480-6431-47ec-93d6-2f16776fe2d2 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e2f89480-6431-47ec-93d6-2f16776fe2d2 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-e2f89480-6431-47ec-93d6-2f16776fe2d2 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:35 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-e2f89480-6431-47ec-93d6-2f16776fe2d2 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] HTTP exception thrown: Instance 334c6825-035f-454c-9804-00ab537f54d1 could not be found. Apr 12 00:44:35 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-e2f89480-6431-47ec-93d6-2f16776fe2d2 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Request method failure captured: Apr 12 00:44:35 user devstack@n-api.service[72495]: request: GET /compute/v2.1/servers/334c6825-035f-454c-9804-00ab537f54d1/os-volume_attachments HTTP/1.1 Apr 12 00:44:35 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:44:35 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:44:35 user devstack@n-api.service[72495]: Connection: close Apr 12 00:44:35 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 00:44:35 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:44:35 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:44:35 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:44:35 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:44:35 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNf5J8I3fRh27iTUx7sPAjFQW4RWDStkRHgWxbQwElGWznm4-kh3K8gOFYpVFFmf_jo8yag3S-jILjsMNnlM4SbOuVYBXAVUaoha0U0ApwgZahD_u2nPD2DpEqApH0-2wlqHdERwJe6PTH_FGzoAlwACatwwjE2_CqFCX_rTtRW_Ss20 Apr 12 00:44:35 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:44:35 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:44:35 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:44:35 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:44:35 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:44:35 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:44:35 user devstack@n-api.service[72495]: X-Project-Id: af94aa5f596c49c08359724ef6780f94 Apr 12 00:44:35 user devstack@n-api.service[72495]: X-Project-Name: tempest-DeleteServersTestJSON-1834816505 Apr 12 00:44:35 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:44:35 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:44:35 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af94aa5f596c49c08359724ef6780f94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/af94aa5f596c49c08359724ef6780f94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af94aa5f596c49c08359724ef6780f94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:44:35 user devstack@n-api.service[72495]: X-Tenant: tempest-DeleteServersTestJSON-1834816505 Apr 12 00:44:35 user devstack@n-api.service[72495]: X-Tenant-Id: af94aa5f596c49c08359724ef6780f94 Apr 12 00:44:35 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-DeleteServersTestJSON-1834816505 Apr 12 00:44:35 user devstack@n-api.service[72495]: X-User: tempest-DeleteServersTestJSON-1834816505-project-member Apr 12 00:44:35 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:44:35 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:44:35 user devstack@n-api.service[72495]: X-User-Id: 6d5c08640a8b4472a99ea037612a1332 Apr 12 00:44:35 user devstack@n-api.service[72495]: X-User-Name: tempest-DeleteServersTestJSON-1834816505-project-member Apr 12 00:44:35 user devstack@n-api.service[72495]: method: > Apr 12 00:44:35 user devstack@n-api.service[72495]: exception: Instance 334c6825-035f-454c-9804-00ab537f54d1 could not be found. Apr 12 00:44:35 user devstack@n-api.service[72495]: action_args: {'server_id': '334c6825-035f-454c-9804-00ab537f54d1'} Apr 12 00:44:35 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 334c6825-035f-454c-9804-00ab537f54d1 could not be found. Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 334c6825-035f-454c-9804-00ab537f54d1 could not be found. Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 334c6825-035f-454c-9804-00ab537f54d1 could not be found. Apr 12 00:44:35 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:44:35 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-e2f89480-6431-47ec-93d6-2f16776fe2d2 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Returning 404 to user: Instance 334c6825-035f-454c-9804-00ab537f54d1 could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:44:35 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-e2f89480-6431-47ec-93d6-2f16776fe2d2 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] 10.0.0.210 "GET /compute/v2.1/servers/334c6825-035f-454c-9804-00ab537f54d1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.045946 Apr 12 00:44:35 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 235/711] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:44:35 2023] GET /compute/v2.1/servers/334c6825-035f-454c-9804-00ab537f54d1/os-volume_attachments => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:44:38 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-7fd0b3e8-31bb-4d2b-b674-e38da4bce859 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:38 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-7fd0b3e8-31bb-4d2b-b674-e38da4bce859 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:44:38 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=12 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:44:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7fd0b3e8-31bb-4d2b-b674-e38da4bce859 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7fd0b3e8-31bb-4d2b-b674-e38da4bce859 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7fd0b3e8-31bb-4d2b-b674-e38da4bce859 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7fd0b3e8-31bb-4d2b-b674-e38da4bce859 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7fd0b3e8-31bb-4d2b-b674-e38da4bce859 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-7fd0b3e8-31bb-4d2b-b674-e38da4bce859 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:38 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-7fd0b3e8-31bb-4d2b-b674-e38da4bce859 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] HTTP exception thrown: Instance 334c6825-035f-454c-9804-00ab537f54d1 could not be found. Apr 12 00:44:38 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-7fd0b3e8-31bb-4d2b-b674-e38da4bce859 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Request method failure captured: Apr 12 00:44:38 user devstack@n-api.service[72496]: request: DELETE /compute/v2.1/servers/334c6825-035f-454c-9804-00ab537f54d1 HTTP/1.1 Apr 12 00:44:38 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:44:38 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:44:38 user devstack@n-api.service[72496]: Connection: close Apr 12 00:44:38 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:44:38 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:44:38 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:44:38 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:44:38 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:44:38 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNf5J8I3fRh27iTUx7sPAjFQW4RWDStkRHgWxbQwElGWznm4-kh3K8gOFYpVFFmf_jo8yag3S-jILjsMNnlM4SbOuVYBXAVUaoha0U0ApwgZahD_u2nPD2DpEqApH0-2wlqHdERwJe6PTH_FGzoAlwACatwwjE2_CqFCX_rTtRW_Ss20 Apr 12 00:44:38 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:44:38 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:44:38 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:44:38 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:44:38 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:44:38 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:44:38 user devstack@n-api.service[72496]: X-Project-Id: af94aa5f596c49c08359724ef6780f94 Apr 12 00:44:38 user devstack@n-api.service[72496]: X-Project-Name: tempest-DeleteServersTestJSON-1834816505 Apr 12 00:44:38 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:44:38 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:44:38 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af94aa5f596c49c08359724ef6780f94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/af94aa5f596c49c08359724ef6780f94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af94aa5f596c49c08359724ef6780f94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:44:38 user devstack@n-api.service[72496]: X-Tenant: tempest-DeleteServersTestJSON-1834816505 Apr 12 00:44:38 user devstack@n-api.service[72496]: X-Tenant-Id: af94aa5f596c49c08359724ef6780f94 Apr 12 00:44:38 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-DeleteServersTestJSON-1834816505 Apr 12 00:44:38 user devstack@n-api.service[72496]: X-User: tempest-DeleteServersTestJSON-1834816505-project-member Apr 12 00:44:38 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:44:38 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:44:38 user devstack@n-api.service[72496]: X-User-Id: 6d5c08640a8b4472a99ea037612a1332 Apr 12 00:44:38 user devstack@n-api.service[72496]: X-User-Name: tempest-DeleteServersTestJSON-1834816505-project-member Apr 12 00:44:38 user devstack@n-api.service[72496]: method: > Apr 12 00:44:38 user devstack@n-api.service[72496]: exception: Instance 334c6825-035f-454c-9804-00ab537f54d1 could not be found. Apr 12 00:44:38 user devstack@n-api.service[72496]: action_args: {'id': '334c6825-035f-454c-9804-00ab537f54d1'} Apr 12 00:44:38 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 334c6825-035f-454c-9804-00ab537f54d1 could not be found. Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 334c6825-035f-454c-9804-00ab537f54d1 could not be found. Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 334c6825-035f-454c-9804-00ab537f54d1 could not be found. Apr 12 00:44:38 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:44:38 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-7fd0b3e8-31bb-4d2b-b674-e38da4bce859 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Returning 404 to user: Instance 334c6825-035f-454c-9804-00ab537f54d1 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:44:38 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-7fd0b3e8-31bb-4d2b-b674-e38da4bce859 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/334c6825-035f-454c-9804-00ab537f54d1" status: 404 len: 111 microversion: 2.1 time: 0.033817 Apr 12 00:44:38 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 240/712] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:44:38 2023] DELETE /compute/v2.1/servers/334c6825-035f-454c-9804-00ab537f54d1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:44:38 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-8fc0e58c-0001-4ab0-9bbf-d1a3fc6f8022 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:38 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-8fc0e58c-0001-4ab0-9bbf-d1a3fc6f8022 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] [instance: 334c6825-035f-454c-9804-00ab537f54d1] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:44:38 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8fc0e58c-0001-4ab0-9bbf-d1a3fc6f8022 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:38 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8fc0e58c-0001-4ab0-9bbf-d1a3fc6f8022 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:38 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8fc0e58c-0001-4ab0-9bbf-d1a3fc6f8022 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:38 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8fc0e58c-0001-4ab0-9bbf-d1a3fc6f8022 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:38 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8fc0e58c-0001-4ab0-9bbf-d1a3fc6f8022 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:38 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8fc0e58c-0001-4ab0-9bbf-d1a3fc6f8022 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:39 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-8fc0e58c-0001-4ab0-9bbf-d1a3fc6f8022 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] HTTP exception thrown: Instance 334c6825-035f-454c-9804-00ab537f54d1 could not be found. Apr 12 00:44:39 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-8fc0e58c-0001-4ab0-9bbf-d1a3fc6f8022 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Request method failure captured: Apr 12 00:44:39 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/334c6825-035f-454c-9804-00ab537f54d1 HTTP/1.1 Apr 12 00:44:39 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:44:39 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:44:39 user devstack@n-api.service[72494]: Connection: close Apr 12 00:44:39 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:44:39 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:44:39 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:44:39 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:44:39 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:44:39 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNf5J8I3fRh27iTUx7sPAjFQW4RWDStkRHgWxbQwElGWznm4-kh3K8gOFYpVFFmf_jo8yag3S-jILjsMNnlM4SbOuVYBXAVUaoha0U0ApwgZahD_u2nPD2DpEqApH0-2wlqHdERwJe6PTH_FGzoAlwACatwwjE2_CqFCX_rTtRW_Ss20 Apr 12 00:44:39 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:44:39 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:44:39 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:44:39 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:44:39 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:44:39 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:44:39 user devstack@n-api.service[72494]: X-Project-Id: af94aa5f596c49c08359724ef6780f94 Apr 12 00:44:39 user devstack@n-api.service[72494]: X-Project-Name: tempest-DeleteServersTestJSON-1834816505 Apr 12 00:44:39 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:44:39 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:44:39 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af94aa5f596c49c08359724ef6780f94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/af94aa5f596c49c08359724ef6780f94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/af94aa5f596c49c08359724ef6780f94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:44:39 user devstack@n-api.service[72494]: X-Tenant: tempest-DeleteServersTestJSON-1834816505 Apr 12 00:44:39 user devstack@n-api.service[72494]: X-Tenant-Id: af94aa5f596c49c08359724ef6780f94 Apr 12 00:44:39 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-DeleteServersTestJSON-1834816505 Apr 12 00:44:39 user devstack@n-api.service[72494]: X-User: tempest-DeleteServersTestJSON-1834816505-project-member Apr 12 00:44:39 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:44:39 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:44:39 user devstack@n-api.service[72494]: X-User-Id: 6d5c08640a8b4472a99ea037612a1332 Apr 12 00:44:39 user devstack@n-api.service[72494]: X-User-Name: tempest-DeleteServersTestJSON-1834816505-project-member Apr 12 00:44:39 user devstack@n-api.service[72494]: method: > Apr 12 00:44:39 user devstack@n-api.service[72494]: exception: Instance 334c6825-035f-454c-9804-00ab537f54d1 could not be found. Apr 12 00:44:39 user devstack@n-api.service[72494]: action_args: {'id': '334c6825-035f-454c-9804-00ab537f54d1'} Apr 12 00:44:39 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 334c6825-035f-454c-9804-00ab537f54d1 could not be found. Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 334c6825-035f-454c-9804-00ab537f54d1 could not be found. Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 334c6825-035f-454c-9804-00ab537f54d1 could not be found. Apr 12 00:44:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:44:39 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-8fc0e58c-0001-4ab0-9bbf-d1a3fc6f8022 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] Returning 404 to user: Instance 334c6825-035f-454c-9804-00ab537f54d1 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:44:39 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-8fc0e58c-0001-4ab0-9bbf-d1a3fc6f8022 tempest-DeleteServersTestJSON-1834816505 tempest-DeleteServersTestJSON-1834816505-project-member] 10.0.0.210 "GET /compute/v2.1/servers/334c6825-035f-454c-9804-00ab537f54d1" status: 404 len: 111 microversion: 2.1 time: 0.028260 Apr 12 00:44:39 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 238/713] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:44:38 2023] GET /compute/v2.1/servers/334c6825-035f-454c-9804-00ab537f54d1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:44:40 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-be600ec0-8155-46b0-8d25-2e3e4ebbc4e3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-629855207"}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:44:40 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-be600ec0-8155-46b0-8d25-2e3e4ebbc4e3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:44:40 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:44:40 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:44:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-be600ec0-8155-46b0-8d25-2e3e4ebbc4e3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-be600ec0-8155-46b0-8d25-2e3e4ebbc4e3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-be600ec0-8155-46b0-8d25-2e3e4ebbc4e3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-be600ec0-8155-46b0-8d25-2e3e4ebbc4e3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-be600ec0-8155-46b0-8d25-2e3e4ebbc4e3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-be600ec0-8155-46b0-8d25-2e3e4ebbc4e3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:40 user devstack@n-api.service[72495]: INFO nova.network.security_group_api [None req-be600ec0-8155-46b0-8d25-2e3e4ebbc4e3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Removing security group 2b9389d1-46c8-44b9-baa7-c1763e2e60a2 from port d1cda216-0dbb-4296-81c2-9386697372d2 Apr 12 00:44:41 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-be600ec0-8155-46b0-8d25-2e3e4ebbc4e3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763/action" status: 202 len: 0 microversion: 2.1 time: 0.564833 Apr 12 00:44:41 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 236/714] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 00:44:40 2023] POST /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763/action => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:44:41 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-46764cd2-8d73-4d31-95e8-876ccf9f253e req-a2584f62-9b00-404a-ad73-0fb5bd009658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c57eddf0-bf85-4b87-a352-57508a728763", "tag": "d1cda216-0dbb-4296-81c2-9386697372d2"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:44:41 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-46764cd2-8d73-4d31-95e8-876ccf9f253e req-a2584f62-9b00-404a-ad73-0fb5bd009658 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:41 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-46764cd2-8d73-4d31-95e8-876ccf9f253e req-a2584f62-9b00-404a-ad73-0fb5bd009658 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:41 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-46764cd2-8d73-4d31-95e8-876ccf9f253e req-a2584f62-9b00-404a-ad73-0fb5bd009658 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:41 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-46764cd2-8d73-4d31-95e8-876ccf9f253e req-a2584f62-9b00-404a-ad73-0fb5bd009658 service nova] Creating event network-changed:d1cda216-0dbb-4296-81c2-9386697372d2 for instance c57eddf0-bf85-4b87-a352-57508a728763 on user Apr 12 00:44:41 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-46764cd2-8d73-4d31-95e8-876ccf9f253e req-a2584f62-9b00-404a-ad73-0fb5bd009658 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031300 Apr 12 00:44:41 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 241/715] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:44:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:41 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:41 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:44:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:42 user devstack@n-api.service[72494]: DEBUG nova.objects.instance [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lazy-loading 'services' on Instance uuid c57eddf0-bf85-4b87-a352-57508a728763 {{(pid=72494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:44:42 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-302ac49f-8749-4262-86fc-8d57f903badd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763/os-volume_attachments/08438351-ef8b-444d-ad94-8d60d0c47d37" status: 202 len: 0 microversion: 2.1 time: 0.192523 Apr 12 00:44:42 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 239/716] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 00:44:41 2023] DELETE /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763/os-volume_attachments/08438351-ef8b-444d-ad94-8d60d0c47d37 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:44:42 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-8bbdd276-6aef-48f6-bdc6-662023eb9501 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:42 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-8bbdd276-6aef-48f6-bdc6-662023eb9501 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:44:42 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8bbdd276-6aef-48f6-bdc6-662023eb9501 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:42 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8bbdd276-6aef-48f6-bdc6-662023eb9501 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:42 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8bbdd276-6aef-48f6-bdc6-662023eb9501 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:42 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8bbdd276-6aef-48f6-bdc6-662023eb9501 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:42 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8bbdd276-6aef-48f6-bdc6-662023eb9501 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:42 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8bbdd276-6aef-48f6-bdc6-662023eb9501 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:42 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-8bbdd276-6aef-48f6-bdc6-662023eb9501 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043519 Apr 12 00:44:42 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 237/717] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:44:42 2023] GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:43 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-486c9700-2b41-4694-a1aa-921f1a569cb7 req-c83f2886-2ae7-40af-98dd-284a91458d42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c57eddf0-bf85-4b87-a352-57508a728763", "tag": "d1cda216-0dbb-4296-81c2-9386697372d2"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:44:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-486c9700-2b41-4694-a1aa-921f1a569cb7 req-c83f2886-2ae7-40af-98dd-284a91458d42 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-486c9700-2b41-4694-a1aa-921f1a569cb7 req-c83f2886-2ae7-40af-98dd-284a91458d42 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-486c9700-2b41-4694-a1aa-921f1a569cb7 req-c83f2886-2ae7-40af-98dd-284a91458d42 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:43 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-486c9700-2b41-4694-a1aa-921f1a569cb7 req-c83f2886-2ae7-40af-98dd-284a91458d42 service nova] Creating event network-changed:d1cda216-0dbb-4296-81c2-9386697372d2 for instance c57eddf0-bf85-4b87-a352-57508a728763 on user Apr 12 00:44:43 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-486c9700-2b41-4694-a1aa-921f1a569cb7 req-c83f2886-2ae7-40af-98dd-284a91458d42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033602 Apr 12 00:44:43 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 242/718] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:44:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:46 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-b0e070d3-604d-41aa-8f2c-4b731121abf6 tempest-VolumesTestJSON-55945393 tempest-VolumesTestJSON-55945393-project-member] Calling method '.version_select at 0x7f7cd45d8c10>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:46 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-b0e070d3-604d-41aa-8f2c-4b731121abf6 tempest-VolumesTestJSON-55945393 tempest-VolumesTestJSON-55945393-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4ad73bdf-b758-4df2-812a-7b9b5c01b3e5" status: 200 len: 351 microversion: 2.1 time: 0.236536 Apr 12 00:44:46 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 240/719] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 00:44:46 2023] GET /compute/v2.1/os-volumes/4ad73bdf-b758-4df2-812a-7b9b5c01b3e5 => generated 351 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:47 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-1ef1c043-5539-4db3-b17f-6ed69494e60a tempest-VolumesTestJSON-55945393 tempest-VolumesTestJSON-55945393-project-member] Calling method '.version_select at 0x7f7cd45b79a0>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:47 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-1ef1c043-5539-4db3-b17f-6ed69494e60a tempest-VolumesTestJSON-55945393 tempest-VolumesTestJSON-55945393-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/827f5000-b03b-463f-8a96-ac7b68bc8ed2" status: 200 len: 350 microversion: 2.1 time: 0.057329 Apr 12 00:44:47 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 238/720] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 00:44:47 2023] GET /compute/v2.1/os-volumes/827f5000-b03b-463f-8a96-ac7b68bc8ed2 => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:49 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-3872b29d-d430-4426-aecf-2cba01d7e460 tempest-VolumesTestJSON-55945393 tempest-VolumesTestJSON-55945393-project-member] Calling method '.version_select at 0x7f7cd4623f40>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:49 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-3872b29d-d430-4426-aecf-2cba01d7e460 tempest-VolumesTestJSON-55945393 tempest-VolumesTestJSON-55945393-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4fb389e3-15e2-44ad-9d91-886df8033551" status: 200 len: 349 microversion: 2.1 time: 0.131924 Apr 12 00:44:49 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 243/721] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 00:44:49 2023] GET /compute/v2.1/os-volumes/4fb389e3-15e2-44ad-9d91-886df8033551 => generated 349 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:49 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-b2bfef00-df1a-4e94-837b-b7caeaa49c79 tempest-VolumesTestJSON-55945393 tempest-VolumesTestJSON-55945393-project-member] Calling method '.version_select at 0x7f7cd446e3b0>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:49 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-b2bfef00-df1a-4e94-837b-b7caeaa49c79 tempest-VolumesTestJSON-55945393 tempest-VolumesTestJSON-55945393-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.097025 Apr 12 00:44:49 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 241/722] 10.0.0.210 () {62 vars in 1211 bytes} [Wed Apr 12 00:44:49 2023] GET /compute/v2.1/os-volumes => generated 1033 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:44:49 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-ad763336-402a-402c-9000-bac662e66cc5 tempest-VolumesTestJSON-55945393 tempest-VolumesTestJSON-55945393-project-member] Calling method '.version_select at 0x7f7cd466d990>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:49 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-ad763336-402a-402c-9000-bac662e66cc5 tempest-VolumesTestJSON-55945393 tempest-VolumesTestJSON-55945393-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.093730 Apr 12 00:44:49 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 239/723] 10.0.0.210 () {62 vars in 1226 bytes} [Wed Apr 12 00:44:49 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:49 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-bf79bbe1-ff23-442b-9478-6cad2e1c786e tempest-VolumesTestJSON-55945393 tempest-VolumesTestJSON-55945393-project-member] Calling method '.version_select at 0x7f7cd4474f70>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:49 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-bf79bbe1-ff23-442b-9478-6cad2e1c786e tempest-VolumesTestJSON-55945393 tempest-VolumesTestJSON-55945393-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.093760 Apr 12 00:44:49 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 244/724] 10.0.0.210 () {62 vars in 1211 bytes} [Wed Apr 12 00:44:49 2023] GET /compute/v2.1/os-volumes => generated 1033 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:44:49 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-1f553c66-4ef6-44a2-b34a-6336404305c6 tempest-VolumesTestJSON-55945393 tempest-VolumesTestJSON-55945393-project-member] Calling method '.version_select at 0x7f7cd45d8c10>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:49 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-1f553c66-4ef6-44a2-b34a-6336404305c6 tempest-VolumesTestJSON-55945393 tempest-VolumesTestJSON-55945393-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.081369 Apr 12 00:44:49 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 242/725] 10.0.0.210 () {62 vars in 1244 bytes} [Wed Apr 12 00:44:49 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:49 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-7ffcda59-566b-412f-baab-a6d1011a8794 tempest-VolumesTestJSON-55945393 tempest-VolumesTestJSON-55945393-project-member] Calling method '.version_select at 0x7f7cd48d7490>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:49 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-7ffcda59-566b-412f-baab-a6d1011a8794 tempest-VolumesTestJSON-55945393 tempest-VolumesTestJSON-55945393-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.086955 Apr 12 00:44:49 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 240/726] 10.0.0.210 () {62 vars in 1247 bytes} [Wed Apr 12 00:44:49 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:49 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-04c8d792-5ee1-4e75-9eef-4ed318248154 tempest-VolumesTestJSON-55945393 tempest-VolumesTestJSON-55945393-project-member] Calling method '.version_select at 0x7f7cd4620e50>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:49 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-04c8d792-5ee1-4e75-9eef-4ed318248154 tempest-VolumesTestJSON-55945393 tempest-VolumesTestJSON-55945393-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.080428 Apr 12 00:44:49 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 245/727] 10.0.0.210 () {62 vars in 1232 bytes} [Wed Apr 12 00:44:49 2023] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:44:49 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-61f15837-ba77-4d9c-8ad1-9fe6f9c4f8c5 tempest-VolumesTestJSON-55945393 tempest-VolumesTestJSON-55945393-project-member] Calling method '.version_select at 0x7f7cd446f0a0>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:50 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-61f15837-ba77-4d9c-8ad1-9fe6f9c4f8c5 tempest-VolumesTestJSON-55945393 tempest-VolumesTestJSON-55945393-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091764 Apr 12 00:44:50 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 243/728] 10.0.0.210 () {62 vars in 1265 bytes} [Wed Apr 12 00:44:49 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:50 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-23faec54-3ffa-4d5d-b325-132e2879b740 tempest-VolumesTestJSON-55945393 tempest-VolumesTestJSON-55945393-project-member] Calling method '.version_select at 0x7f7cd45b6cb0>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:50 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-23faec54-3ffa-4d5d-b325-132e2879b740 tempest-VolumesTestJSON-55945393 tempest-VolumesTestJSON-55945393-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.146318 Apr 12 00:44:50 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 241/729] 10.0.0.210 () {62 vars in 1232 bytes} [Wed Apr 12 00:44:50 2023] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:44:50 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-52a4e135-3286-4695-80fc-953eae03885c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:50 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-52a4e135-3286-4695-80fc-953eae03885c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:44:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-52a4e135-3286-4695-80fc-953eae03885c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-52a4e135-3286-4695-80fc-953eae03885c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-52a4e135-3286-4695-80fc-953eae03885c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-52a4e135-3286-4695-80fc-953eae03885c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-52a4e135-3286-4695-80fc-953eae03885c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-52a4e135-3286-4695-80fc-953eae03885c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:50 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-52a4e135-3286-4695-80fc-953eae03885c tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043864 Apr 12 00:44:50 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 246/730] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:44:50 2023] GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:44:51 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:51 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:44:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:51 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=24,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:44:51 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Going to try to terminate instance {{(pid=72494) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:44:51 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-cdc5fa42-8375-4fe3-9c57-7971f65431ba tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d" status: 204 len: 0 microversion: 2.1 time: 0.147148 Apr 12 00:44:51 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 244/731] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:44:50 2023] DELETE /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:44:51 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-bf8ce484-0825-4a83-a6e4-850d4e1c502f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:51 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-bf8ce484-0825-4a83-a6e4-850d4e1c502f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:44:51 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-bf8ce484-0825-4a83-a6e4-850d4e1c502f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:51 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-bf8ce484-0825-4a83-a6e4-850d4e1c502f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:51 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-bf8ce484-0825-4a83-a6e4-850d4e1c502f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:51 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-bf8ce484-0825-4a83-a6e4-850d4e1c502f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:51 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-bf8ce484-0825-4a83-a6e4-850d4e1c502f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:51 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-bf8ce484-0825-4a83-a6e4-850d4e1c502f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:51 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-bf8ce484-0825-4a83-a6e4-850d4e1c502f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9421443b2f421298a934122c6a8b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf1fea74ef143e6b394e41e7c4ed495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:44:51 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-bf8ce484-0825-4a83-a6e4-850d4e1c502f tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d" status: 200 len: 1677 microversion: 2.1 time: 0.163769 Apr 12 00:44:51 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 242/732] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:44:51 2023] GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:44:51 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-73bf3236-ecd1-4d2b-bbb2-9ec9c14a9821 req-40e54bef-aeed-46e5-af82-579976c4ef93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c8e8b7-1f91-4cf5-a222-c787a186444d", "name": "network-vif-unplugged", "status": "completed", "tag": "a2a25522-be49-4ac7-9893-d030dc2d87ab"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:44:51 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-73bf3236-ecd1-4d2b-bbb2-9ec9c14a9821 req-40e54bef-aeed-46e5-af82-579976c4ef93 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:51 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-73bf3236-ecd1-4d2b-bbb2-9ec9c14a9821 req-40e54bef-aeed-46e5-af82-579976c4ef93 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:51 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-73bf3236-ecd1-4d2b-bbb2-9ec9c14a9821 req-40e54bef-aeed-46e5-af82-579976c4ef93 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:51 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-73bf3236-ecd1-4d2b-bbb2-9ec9c14a9821 req-40e54bef-aeed-46e5-af82-579976c4ef93 service nova] Creating event network-vif-unplugged:a2a25522-be49-4ac7-9893-d030dc2d87ab for instance 49c8e8b7-1f91-4cf5-a222-c787a186444d on user Apr 12 00:44:51 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-73bf3236-ecd1-4d2b-bbb2-9ec9c14a9821 req-40e54bef-aeed-46e5-af82-579976c4ef93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044922 Apr 12 00:44:51 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 247/733] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:44:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:52 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-64a37911-26d5-4d22-b7a6-4fd8cb416e17 req-ad3520dc-c2e6-43a3-bb10-ff7775ada7bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c8e8b7-1f91-4cf5-a222-c787a186444d", "name": "network-vif-deleted", "tag": "a2a25522-be49-4ac7-9893-d030dc2d87ab"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:44:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-64a37911-26d5-4d22-b7a6-4fd8cb416e17 req-ad3520dc-c2e6-43a3-bb10-ff7775ada7bb service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-64a37911-26d5-4d22-b7a6-4fd8cb416e17 req-ad3520dc-c2e6-43a3-bb10-ff7775ada7bb service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-64a37911-26d5-4d22-b7a6-4fd8cb416e17 req-ad3520dc-c2e6-43a3-bb10-ff7775ada7bb service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:52 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-64a37911-26d5-4d22-b7a6-4fd8cb416e17 req-ad3520dc-c2e6-43a3-bb10-ff7775ada7bb service nova] Creating event network-vif-deleted:a2a25522-be49-4ac7-9893-d030dc2d87ab for instance 49c8e8b7-1f91-4cf5-a222-c787a186444d on user Apr 12 00:44:52 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-64a37911-26d5-4d22-b7a6-4fd8cb416e17 req-ad3520dc-c2e6-43a3-bb10-ff7775ada7bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030062 Apr 12 00:44:52 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 245/734] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:44:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:53 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-86c554d6-0d18-41eb-a58e-412bc3c2b1e7 req-ffd3b423-9d4d-4679-8803-ad9e53e5c592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c8e8b7-1f91-4cf5-a222-c787a186444d", "name": "network-vif-plugged", "status": "completed", "tag": "a2a25522-be49-4ac7-9893-d030dc2d87ab"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:44:53 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-86c554d6-0d18-41eb-a58e-412bc3c2b1e7 req-ffd3b423-9d4d-4679-8803-ad9e53e5c592 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:53 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-86c554d6-0d18-41eb-a58e-412bc3c2b1e7 req-ffd3b423-9d4d-4679-8803-ad9e53e5c592 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:53 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-86c554d6-0d18-41eb-a58e-412bc3c2b1e7 req-ffd3b423-9d4d-4679-8803-ad9e53e5c592 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:53 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-86c554d6-0d18-41eb-a58e-412bc3c2b1e7 req-ffd3b423-9d4d-4679-8803-ad9e53e5c592 service nova] Creating event network-vif-plugged:a2a25522-be49-4ac7-9893-d030dc2d87ab for instance 49c8e8b7-1f91-4cf5-a222-c787a186444d on user Apr 12 00:44:53 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-86c554d6-0d18-41eb-a58e-412bc3c2b1e7 req-ffd3b423-9d4d-4679-8803-ad9e53e5c592 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034083 Apr 12 00:44:53 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 243/735] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:44:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:44:54 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-4ab4eb58-8288-4f42-ab07-f50ae511f68b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:44:54 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-4ab4eb58-8288-4f42-ab07-f50ae511f68b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:44:54 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4ab4eb58-8288-4f42-ab07-f50ae511f68b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:54 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4ab4eb58-8288-4f42-ab07-f50ae511f68b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:54 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4ab4eb58-8288-4f42-ab07-f50ae511f68b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:54 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4ab4eb58-8288-4f42-ab07-f50ae511f68b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:44:54 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4ab4eb58-8288-4f42-ab07-f50ae511f68b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:44:54 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4ab4eb58-8288-4f42-ab07-f50ae511f68b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:44:54 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-4ab4eb58-8288-4f42-ab07-f50ae511f68b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:44:54 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-4ab4eb58-8288-4f42-ab07-f50ae511f68b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5d898c2-8548-4b32-829e-6afa11e1985f" status: 200 len: 1442 microversion: 2.1 time: 0.170021 Apr 12 00:44:54 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 248/736] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:44:54 2023] GET /compute/v2.1/servers/e5d898c2-8548-4b32-829e-6afa11e1985f => generated 1442 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:45:08 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:45:08 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:45:08 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-849524f3-80ce-4436-9e19-66a9f780291d tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:45:08 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-849524f3-80ce-4436-9e19-66a9f780291d tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:45:08 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-849524f3-80ce-4436-9e19-66a9f780291d tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:08 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-849524f3-80ce-4436-9e19-66a9f780291d tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:08 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-849524f3-80ce-4436-9e19-66a9f780291d tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:08 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-849524f3-80ce-4436-9e19-66a9f780291d tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:08 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-849524f3-80ce-4436-9e19-66a9f780291d tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:08 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-849524f3-80ce-4436-9e19-66a9f780291d tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:09 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-849524f3-80ce-4436-9e19-66a9f780291d tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:45:09 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-849524f3-80ce-4436-9e19-66a9f780291d tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84861eef-6d59-448b-b6b7-eb8dd8e47b30" status: 200 len: 1540 microversion: 2.1 time: 0.163481 Apr 12 00:45:09 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 246/737] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:45:08 2023] GET /compute/v2.1/servers/84861eef-6d59-448b-b6b7-eb8dd8e47b30 => generated 1540 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:45:09 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=11 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:45:09 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=21 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:45:09 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1944310669", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "destination_type": "volume"}], "networks": [{"uuid": "2e59f1f4-986f-4135-b7f2-1d333d3017ad"}]}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:45:09 user devstack@n-api.service[72495]: DEBUG nova.network.neutron [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] validate_networks() for [('2e59f1f4-986f-4135-b7f2-1d333d3017ad', None, None, None, None, None)] {{(pid=72495) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:45:10 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Flavor limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:45:10 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Image limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:45:10 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Flavor pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:45:10 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Image pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:45:10 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:45:10 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:10 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:10 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:10 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:10 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:10 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:10 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Getting quotas for project f4a7eb4a2a09418eacdeaccefbf7de15. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:45:10 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Getting quotas for user 69d6e340820641729772cf35648ef785 and project f4a7eb4a2a09418eacdeaccefbf7de15. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:45:10 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Going to run 1 instances... {{(pid=72495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:45:10 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=72495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:45:10 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-55af42c7-5a33-4968-b35c-aa9d6efe1b85 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.745959 Apr 12 00:45:10 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 244/738] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 00:45:09 2023] POST /compute/v2.1/servers => generated 378 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 00:45:10 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-11305a69-7005-43d8-87ef-1681715e4ca8 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:45:10 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-11305a69-7005-43d8-87ef-1681715e4ca8 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:45:10 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=13 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:45:10 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=22 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:45:10 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-11305a69-7005-43d8-87ef-1681715e4ca8 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:45:10 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-11305a69-7005-43d8-87ef-1681715e4ca8 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:45:10 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-11305a69-7005-43d8-87ef-1681715e4ca8 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:45:10 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-11305a69-7005-43d8-87ef-1681715e4ca8 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0c7ca20-c237-43b0-9a75-2a21392c7fd0" status: 200 len: 1395 microversion: 2.87 time: 0.079748 Apr 12 00:45:10 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 249/739] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:45:10 2023] GET /compute/v2.1/servers/b0c7ca20-c237-43b0-9a75-2a21392c7fd0 => generated 1395 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:45:13 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-a5d94a1f-e18c-4b94-8626-68289896d71c req-ed75d374-73c3-4b39-a20b-24a818975ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c7ca20-c237-43b0-9a75-2a21392c7fd0", "tag": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:45:13 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-a5d94a1f-e18c-4b94-8626-68289896d71c req-ed75d374-73c3-4b39-a20b-24a818975ac0 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:13 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-a5d94a1f-e18c-4b94-8626-68289896d71c req-ed75d374-73c3-4b39-a20b-24a818975ac0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:13 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-a5d94a1f-e18c-4b94-8626-68289896d71c req-ed75d374-73c3-4b39-a20b-24a818975ac0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:13 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-a5d94a1f-e18c-4b94-8626-68289896d71c req-ed75d374-73c3-4b39-a20b-24a818975ac0 service nova] Creating event network-changed:2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 on user Apr 12 00:45:13 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-a5d94a1f-e18c-4b94-8626-68289896d71c req-ed75d374-73c3-4b39-a20b-24a818975ac0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034467 Apr 12 00:45:13 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 247/740] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:45:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:45:17 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-cb60b590-5893-4776-aac1-cbafd9ef2535 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:45:17 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-cb60b590-5893-4776-aac1-cbafd9ef2535 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:45:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cb60b590-5893-4776-aac1-cbafd9ef2535 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cb60b590-5893-4776-aac1-cbafd9ef2535 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cb60b590-5893-4776-aac1-cbafd9ef2535 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cb60b590-5893-4776-aac1-cbafd9ef2535 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cb60b590-5893-4776-aac1-cbafd9ef2535 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cb60b590-5893-4776-aac1-cbafd9ef2535 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:18 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-cb60b590-5893-4776-aac1-cbafd9ef2535 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373f582479c441e8ce9849ca694a186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f3c567dc84773a33d596920df727a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:45:18 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-cb60b590-5893-4776-aac1-cbafd9ef2535 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7" status: 200 len: 1542 microversion: 2.1 time: 0.255620 Apr 12 00:45:18 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 245/741] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:45:17 2023] GET /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7 => generated 1542 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:45:25 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-be59c093-f850-4650-be06-c2af67217ddb req-22892cfd-0d51-424d-bcc2-a0df544fb9ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c7ca20-c237-43b0-9a75-2a21392c7fd0", "name": "network-vif-plugged", "status": "completed", "tag": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:45:25 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:45:25 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:45:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-be59c093-f850-4650-be06-c2af67217ddb req-22892cfd-0d51-424d-bcc2-a0df544fb9ad service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-be59c093-f850-4650-be06-c2af67217ddb req-22892cfd-0d51-424d-bcc2-a0df544fb9ad service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-be59c093-f850-4650-be06-c2af67217ddb req-22892cfd-0d51-424d-bcc2-a0df544fb9ad service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:25 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-be59c093-f850-4650-be06-c2af67217ddb req-22892cfd-0d51-424d-bcc2-a0df544fb9ad service nova] Creating event network-vif-plugged:2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 on user Apr 12 00:45:25 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-be59c093-f850-4650-be06-c2af67217ddb req-22892cfd-0d51-424d-bcc2-a0df544fb9ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033957 Apr 12 00:45:25 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 250/742] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:45:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:45:27 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=4 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:45:27 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=8 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:45:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-15340d2a-b0af-42e7-a7ef-6c430d7fbc45 req-468718e5-4aed-4bed-abf7-0aa2041da89c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c7ca20-c237-43b0-9a75-2a21392c7fd0", "name": "network-vif-plugged", "status": "completed", "tag": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:45:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-15340d2a-b0af-42e7-a7ef-6c430d7fbc45 req-468718e5-4aed-4bed-abf7-0aa2041da89c service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-15340d2a-b0af-42e7-a7ef-6c430d7fbc45 req-468718e5-4aed-4bed-abf7-0aa2041da89c service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-15340d2a-b0af-42e7-a7ef-6c430d7fbc45 req-468718e5-4aed-4bed-abf7-0aa2041da89c service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:27 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-15340d2a-b0af-42e7-a7ef-6c430d7fbc45 req-468718e5-4aed-4bed-abf7-0aa2041da89c service nova] Creating event network-vif-plugged:2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 on user Apr 12 00:45:27 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-15340d2a-b0af-42e7-a7ef-6c430d7fbc45 req-468718e5-4aed-4bed-abf7-0aa2041da89c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034226 Apr 12 00:45:27 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 248/743] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:45:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:45:32 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:45:32 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:45:32 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:45:32 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=8 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:45:32 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-51907efb-eaac-4672-96b5-3bb09741c45b tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:45:32 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-51907efb-eaac-4672-96b5-3bb09741c45b tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:45:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-51907efb-eaac-4672-96b5-3bb09741c45b tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-51907efb-eaac-4672-96b5-3bb09741c45b tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-51907efb-eaac-4672-96b5-3bb09741c45b tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-51907efb-eaac-4672-96b5-3bb09741c45b tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-51907efb-eaac-4672-96b5-3bb09741c45b tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-51907efb-eaac-4672-96b5-3bb09741c45b tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:32 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-51907efb-eaac-4672-96b5-3bb09741c45b tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048326 Apr 12 00:45:32 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 246/744] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:45:32 2023] GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:45:32 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-bc609dde-bb43-4316-be1c-71f0621fbb7a tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:45:32 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-bc609dde-bb43-4316-be1c-71f0621fbb7a tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:45:32 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-bc609dde-bb43-4316-be1c-71f0621fbb7a tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:32 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-bc609dde-bb43-4316-be1c-71f0621fbb7a tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:32 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-bc609dde-bb43-4316-be1c-71f0621fbb7a tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:32 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-bc609dde-bb43-4316-be1c-71f0621fbb7a tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:32 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-bc609dde-bb43-4316-be1c-71f0621fbb7a tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:32 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-bc609dde-bb43-4316-be1c-71f0621fbb7a tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:32 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-bc609dde-bb43-4316-be1c-71f0621fbb7a tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] HTTP exception thrown: Instance c57eddf0-bf85-4b87-a352-57508a728763 is not attached to volume 08438351-ef8b-444d-ad94-8d60d0c47d37 Apr 12 00:45:32 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-bc609dde-bb43-4316-be1c-71f0621fbb7a tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Request method failure captured: Apr 12 00:45:32 user devstack@n-api.service[72496]: request: DELETE /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763/os-volume_attachments/08438351-ef8b-444d-ad94-8d60d0c47d37 HTTP/1.1 Apr 12 00:45:32 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:45:32 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:45:32 user devstack@n-api.service[72496]: Connection: close Apr 12 00:45:32 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:45:32 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:45:32 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:45:32 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:45:32 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:45:32 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNf3_MXW68YWDhh4rdV6_s09Iac6VOPtMLVWpm0rGO_C1gJPbOzQvz6QNsDKExkr7tGyCe2GBMnyNIMBwvCofPc3o4pLjUWgkRI5V8Er_kr32XrEVpmyBXrjPzBF9_uy3WkbWoMTIlSDlSkI30Lw-qDUV_rwBUVs6oI9KWkfrbr0SVjY Apr 12 00:45:32 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:45:32 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:45:32 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:45:32 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:45:32 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:45:32 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:45:32 user devstack@n-api.service[72496]: X-Project-Id: e66fda80cb83402392e155c76ee78e1f Apr 12 00:45:32 user devstack@n-api.service[72496]: X-Project-Name: tempest-TestMinimumBasicScenario-1682364358 Apr 12 00:45:32 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:45:32 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:45:32 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e66fda80cb83402392e155c76ee78e1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e66fda80cb83402392e155c76ee78e1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e66fda80cb83402392e155c76ee78e1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:45:32 user devstack@n-api.service[72496]: X-Tenant: tempest-TestMinimumBasicScenario-1682364358 Apr 12 00:45:32 user devstack@n-api.service[72496]: X-Tenant-Id: e66fda80cb83402392e155c76ee78e1f Apr 12 00:45:32 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1682364358 Apr 12 00:45:32 user devstack@n-api.service[72496]: X-User: tempest-TestMinimumBasicScenario-1682364358-project-member Apr 12 00:45:32 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:45:32 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:45:32 user devstack@n-api.service[72496]: X-User-Id: 2842535891eb4a9880f7e8859dd0de3c Apr 12 00:45:32 user devstack@n-api.service[72496]: X-User-Name: tempest-TestMinimumBasicScenario-1682364358-project-member Apr 12 00:45:32 user devstack@n-api.service[72496]: method: > Apr 12 00:45:32 user devstack@n-api.service[72496]: exception: Instance c57eddf0-bf85-4b87-a352-57508a728763 is not attached to volume 08438351-ef8b-444d-ad94-8d60d0c47d37 Apr 12 00:45:32 user devstack@n-api.service[72496]: action_args: {'server_id': 'c57eddf0-bf85-4b87-a352-57508a728763', 'id': '08438351-ef8b-444d-ad94-8d60d0c47d37'} Apr 12 00:45:32 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 08438351-ef8b-444d-ad94-8d60d0c47d37. Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c57eddf0-bf85-4b87-a352-57508a728763 is not attached to volume 08438351-ef8b-444d-ad94-8d60d0c47d37 Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c57eddf0-bf85-4b87-a352-57508a728763 is not attached to volume 08438351-ef8b-444d-ad94-8d60d0c47d37 Apr 12 00:45:32 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:45:32 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-bc609dde-bb43-4316-be1c-71f0621fbb7a tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Returning 404 to user: Instance c57eddf0-bf85-4b87-a352-57508a728763 is not attached to volume 08438351-ef8b-444d-ad94-8d60d0c47d37 {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:45:32 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-bc609dde-bb43-4316-be1c-71f0621fbb7a tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763/os-volume_attachments/08438351-ef8b-444d-ad94-8d60d0c47d37" status: 404 len: 154 microversion: 2.1 time: 0.094567 Apr 12 00:45:32 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 251/745] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 00:45:32 2023] DELETE /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763/os-volume_attachments/08438351-ef8b-444d-ad94-8d60d0c47d37 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:45:34 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:45:34 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:45:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:34 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Going to try to terminate instance {{(pid=72494) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:45:34 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-0fc20839-497b-41f6-b71b-e5dc2a561fd3 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763" status: 204 len: 0 microversion: 2.1 time: 0.135223 Apr 12 00:45:34 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 249/746] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:45:34 2023] DELETE /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:45:34 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-9755bb50-74af-481b-ad6a-b4724936716d tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:45:34 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-9755bb50-74af-481b-ad6a-b4724936716d tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:45:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9755bb50-74af-481b-ad6a-b4724936716d tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9755bb50-74af-481b-ad6a-b4724936716d tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9755bb50-74af-481b-ad6a-b4724936716d tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9755bb50-74af-481b-ad6a-b4724936716d tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9755bb50-74af-481b-ad6a-b4724936716d tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9755bb50-74af-481b-ad6a-b4724936716d tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:35 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-9755bb50-74af-481b-ad6a-b4724936716d tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842535891eb4a9880f7e8859dd0de3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66fda80cb83402392e155c76ee78e1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:45:35 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-214077e6-4bb7-4fcf-bdda-2c842e6792fc req-c9792e3a-1248-418e-b9c9-021a4f6a2bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c57eddf0-bf85-4b87-a352-57508a728763", "name": "network-vif-unplugged", "status": "completed", "tag": "d1cda216-0dbb-4296-81c2-9386697372d2"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:45:35 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-9755bb50-74af-481b-ad6a-b4724936716d tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763" status: 200 len: 1539 microversion: 2.1 time: 0.518548 Apr 12 00:45:35 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 247/747] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:45:34 2023] GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763 => generated 1539 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:45:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-214077e6-4bb7-4fcf-bdda-2c842e6792fc req-c9792e3a-1248-418e-b9c9-021a4f6a2bd2 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-214077e6-4bb7-4fcf-bdda-2c842e6792fc req-c9792e3a-1248-418e-b9c9-021a4f6a2bd2 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-214077e6-4bb7-4fcf-bdda-2c842e6792fc req-c9792e3a-1248-418e-b9c9-021a4f6a2bd2 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:35 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-214077e6-4bb7-4fcf-bdda-2c842e6792fc req-c9792e3a-1248-418e-b9c9-021a4f6a2bd2 service nova] Creating event network-vif-unplugged:d1cda216-0dbb-4296-81c2-9386697372d2 for instance c57eddf0-bf85-4b87-a352-57508a728763 on user Apr 12 00:45:35 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-214077e6-4bb7-4fcf-bdda-2c842e6792fc req-c9792e3a-1248-418e-b9c9-021a4f6a2bd2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.202030 Apr 12 00:45:35 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 252/748] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:45:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:45:36 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-5cd3e7aa-a587-4fec-acc0-aef4b4c3ad6f req-63d9e507-48ca-4c0d-8451-fe493a2f3fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c57eddf0-bf85-4b87-a352-57508a728763", "name": "network-vif-deleted", "tag": "d1cda216-0dbb-4296-81c2-9386697372d2"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:45:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-5cd3e7aa-a587-4fec-acc0-aef4b4c3ad6f req-63d9e507-48ca-4c0d-8451-fe493a2f3fc9 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-5cd3e7aa-a587-4fec-acc0-aef4b4c3ad6f req-63d9e507-48ca-4c0d-8451-fe493a2f3fc9 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:36 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-5cd3e7aa-a587-4fec-acc0-aef4b4c3ad6f req-63d9e507-48ca-4c0d-8451-fe493a2f3fc9 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:36 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-5cd3e7aa-a587-4fec-acc0-aef4b4c3ad6f req-63d9e507-48ca-4c0d-8451-fe493a2f3fc9 service nova] Creating event network-vif-deleted:d1cda216-0dbb-4296-81c2-9386697372d2 for instance c57eddf0-bf85-4b87-a352-57508a728763 on user Apr 12 00:45:36 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-5cd3e7aa-a587-4fec-acc0-aef4b4c3ad6f req-63d9e507-48ca-4c0d-8451-fe493a2f3fc9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033970 Apr 12 00:45:36 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 250/749] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:45:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:45:37 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-9558fdb7-4885-4df5-b2e5-c6b679eb29c6 req-2a9e187d-158a-4f12-8045-e41e51daa379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c57eddf0-bf85-4b87-a352-57508a728763", "name": "network-vif-plugged", "status": "completed", "tag": "d1cda216-0dbb-4296-81c2-9386697372d2"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:45:37 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-9558fdb7-4885-4df5-b2e5-c6b679eb29c6 req-2a9e187d-158a-4f12-8045-e41e51daa379 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:37 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-9558fdb7-4885-4df5-b2e5-c6b679eb29c6 req-2a9e187d-158a-4f12-8045-e41e51daa379 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:37 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-9558fdb7-4885-4df5-b2e5-c6b679eb29c6 req-2a9e187d-158a-4f12-8045-e41e51daa379 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:37 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-9558fdb7-4885-4df5-b2e5-c6b679eb29c6 req-2a9e187d-158a-4f12-8045-e41e51daa379 service nova] Creating event network-vif-plugged:d1cda216-0dbb-4296-81c2-9386697372d2 for instance c57eddf0-bf85-4b87-a352-57508a728763 on user Apr 12 00:45:37 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-9558fdb7-4885-4df5-b2e5-c6b679eb29c6 req-2a9e187d-158a-4f12-8045-e41e51daa379 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029611 Apr 12 00:45:37 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 248/750] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:45:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:45:41 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-15d118b8-f830-40ac-9358-14d5dbe3aba3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:45:41 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-15d118b8-f830-40ac-9358-14d5dbe3aba3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 49c8e8b7-1f91-4cf5-a222-c787a186444d] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:45:41 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-15d118b8-f830-40ac-9358-14d5dbe3aba3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:41 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-15d118b8-f830-40ac-9358-14d5dbe3aba3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:41 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-15d118b8-f830-40ac-9358-14d5dbe3aba3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:41 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-15d118b8-f830-40ac-9358-14d5dbe3aba3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:41 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-15d118b8-f830-40ac-9358-14d5dbe3aba3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:41 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-15d118b8-f830-40ac-9358-14d5dbe3aba3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:41 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-15d118b8-f830-40ac-9358-14d5dbe3aba3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] HTTP exception thrown: Instance 49c8e8b7-1f91-4cf5-a222-c787a186444d could not be found. Apr 12 00:45:41 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-15d118b8-f830-40ac-9358-14d5dbe3aba3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Request method failure captured: Apr 12 00:45:41 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d HTTP/1.1 Apr 12 00:45:41 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:45:41 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:45:41 user devstack@n-api.service[72496]: Connection: close Apr 12 00:45:41 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:45:41 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:45:41 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:45:41 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:45:41 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:45:41 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNft5KIxwEgdwTqD-CgWzQHRf_FoqYilC4_z8sLEvoXo1R3M7HNE1MMy-1-GlWM0X8BruNgg2BCXLv_-0_S4kRyGh3lOQ6Sb9IfuhvN2rkuUyf5ySkxhKP32iNzWpbdPq8mfldEe_U0xhj5wtI02KiYIEO-zb6pTaOupaX4Sx0JOImss Apr 12 00:45:41 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:45:41 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:45:41 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:45:41 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:45:41 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:45:41 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:45:41 user devstack@n-api.service[72496]: X-Project-Id: fcf1fea74ef143e6b394e41e7c4ed495 Apr 12 00:45:41 user devstack@n-api.service[72496]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1300870234 Apr 12 00:45:41 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:45:41 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:45:41 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fcf1fea74ef143e6b394e41e7c4ed495"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fcf1fea74ef143e6b394e41e7c4ed495"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fcf1fea74ef143e6b394e41e7c4ed495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:45:41 user devstack@n-api.service[72496]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1300870234 Apr 12 00:45:41 user devstack@n-api.service[72496]: X-Tenant-Id: fcf1fea74ef143e6b394e41e7c4ed495 Apr 12 00:45:41 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1300870234 Apr 12 00:45:41 user devstack@n-api.service[72496]: X-User: tempest-ServerRescueNegativeTestJSON-1300870234-project-member Apr 12 00:45:41 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:45:41 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:45:41 user devstack@n-api.service[72496]: X-User-Id: 6b9421443b2f421298a934122c6a8b8c Apr 12 00:45:41 user devstack@n-api.service[72496]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1300870234-project-member Apr 12 00:45:41 user devstack@n-api.service[72496]: method: > Apr 12 00:45:41 user devstack@n-api.service[72496]: exception: Instance 49c8e8b7-1f91-4cf5-a222-c787a186444d could not be found. Apr 12 00:45:41 user devstack@n-api.service[72496]: action_args: {'id': '49c8e8b7-1f91-4cf5-a222-c787a186444d'} Apr 12 00:45:41 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49c8e8b7-1f91-4cf5-a222-c787a186444d could not be found. Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49c8e8b7-1f91-4cf5-a222-c787a186444d could not be found. Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49c8e8b7-1f91-4cf5-a222-c787a186444d could not be found. Apr 12 00:45:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:45:41 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-15d118b8-f830-40ac-9358-14d5dbe3aba3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Returning 404 to user: Instance 49c8e8b7-1f91-4cf5-a222-c787a186444d could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:45:41 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-15d118b8-f830-40ac-9358-14d5dbe3aba3 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d" status: 404 len: 111 microversion: 2.1 time: 0.028095 Apr 12 00:45:41 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 253/751] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:45:41 2023] GET /compute/v2.1/servers/49c8e8b7-1f91-4cf5-a222-c787a186444d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:45:41 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-70cc35f3-be32-487a-ac97-9d25a05c57a7 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '.version_select at 0x7f7cd446f640>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:45:41 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-70cc35f3-be32-487a-ac97-9d25a05c57a7 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-936664235" status: 202 len: 0 microversion: 2.1 time: 0.125216 Apr 12 00:45:41 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 251/752] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 00:45:41 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-936664235 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:45:46 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:45:46 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:45:46 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:46 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:46 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:46 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:46 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:46 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:46 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Going to try to terminate instance {{(pid=72495) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:45:46 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-d9724884-54ed-47cd-9898-73f4e64a021b tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" status: 204 len: 0 microversion: 2.1 time: 0.119988 Apr 12 00:45:46 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 249/753] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:45:46 2023] DELETE /compute/v2.1/servers/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:45:46 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-abe2ab2c-7fbb-4fd7-95cd-9ea84d5e92d7 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:45:46 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-abe2ab2c-7fbb-4fd7-95cd-9ea84d5e92d7 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:45:46 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-abe2ab2c-7fbb-4fd7-95cd-9ea84d5e92d7 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:46 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-abe2ab2c-7fbb-4fd7-95cd-9ea84d5e92d7 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:46 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-abe2ab2c-7fbb-4fd7-95cd-9ea84d5e92d7 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:46 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-abe2ab2c-7fbb-4fd7-95cd-9ea84d5e92d7 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:46 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-abe2ab2c-7fbb-4fd7-95cd-9ea84d5e92d7 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:46 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-abe2ab2c-7fbb-4fd7-95cd-9ea84d5e92d7 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:46 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-abe2ab2c-7fbb-4fd7-95cd-9ea84d5e92d7 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9421443b2f421298a934122c6a8b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf1fea74ef143e6b394e41e7c4ed495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:45:46 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-abe2ab2c-7fbb-4fd7-95cd-9ea84d5e92d7 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" status: 200 len: 1496 microversion: 2.1 time: 0.166338 Apr 12 00:45:46 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 254/754] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:45:46 2023] GET /compute/v2.1/servers/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 => generated 1496 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:45:46 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:45:47 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-a9106562-1825-407d-aec5-463b60b25353 req-07e8098c-65b2-4bd0-acdf-cf50e552cd55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050", "name": "network-vif-unplugged", "status": "completed", "tag": "8cb07b1c-aa00-4fcf-983c-4b42566ef948"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:45:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-a9106562-1825-407d-aec5-463b60b25353 req-07e8098c-65b2-4bd0-acdf-cf50e552cd55 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-a9106562-1825-407d-aec5-463b60b25353 req-07e8098c-65b2-4bd0-acdf-cf50e552cd55 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-a9106562-1825-407d-aec5-463b60b25353 req-07e8098c-65b2-4bd0-acdf-cf50e552cd55 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:47 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-a9106562-1825-407d-aec5-463b60b25353 req-07e8098c-65b2-4bd0-acdf-cf50e552cd55 service nova] Creating event network-vif-unplugged:8cb07b1c-aa00-4fcf-983c-4b42566ef948 for instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 on user Apr 12 00:45:47 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-a9106562-1825-407d-aec5-463b60b25353 req-07e8098c-65b2-4bd0-acdf-cf50e552cd55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.231475 Apr 12 00:45:47 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 252/755] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:45:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:45:47 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-6d79aca1-a61d-4f65-a3fe-7df2219693bb req-8292e874-9b73-4b74-bd5e-c94c12569c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050", "name": "network-vif-deleted", "tag": "8cb07b1c-aa00-4fcf-983c-4b42566ef948"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:45:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-6d79aca1-a61d-4f65-a3fe-7df2219693bb req-8292e874-9b73-4b74-bd5e-c94c12569c17 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-6d79aca1-a61d-4f65-a3fe-7df2219693bb req-8292e874-9b73-4b74-bd5e-c94c12569c17 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-6d79aca1-a61d-4f65-a3fe-7df2219693bb req-8292e874-9b73-4b74-bd5e-c94c12569c17 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:47 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-6d79aca1-a61d-4f65-a3fe-7df2219693bb req-8292e874-9b73-4b74-bd5e-c94c12569c17 service nova] Creating event network-vif-deleted:8cb07b1c-aa00-4fcf-983c-4b42566ef948 for instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 on user Apr 12 00:45:47 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-6d79aca1-a61d-4f65-a3fe-7df2219693bb req-8292e874-9b73-4b74-bd5e-c94c12569c17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122038 Apr 12 00:45:47 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 250/756] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:45:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:45:49 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-2c9af04a-36f3-458c-942c-0b21c870fe19 req-9a64bb14-87f4-4c67-9514-769e685911a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0334c8b1-3d0e-4af5-b86f-a6b41a3d6050", "name": "network-vif-plugged", "status": "completed", "tag": "8cb07b1c-aa00-4fcf-983c-4b42566ef948"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:45:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2c9af04a-36f3-458c-942c-0b21c870fe19 req-9a64bb14-87f4-4c67-9514-769e685911a5 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2c9af04a-36f3-458c-942c-0b21c870fe19 req-9a64bb14-87f4-4c67-9514-769e685911a5 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2c9af04a-36f3-458c-942c-0b21c870fe19 req-9a64bb14-87f4-4c67-9514-769e685911a5 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:49 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-2c9af04a-36f3-458c-942c-0b21c870fe19 req-9a64bb14-87f4-4c67-9514-769e685911a5 service nova] Creating event network-vif-plugged:8cb07b1c-aa00-4fcf-983c-4b42566ef948 for instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 on user Apr 12 00:45:49 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-2c9af04a-36f3-458c-942c-0b21c870fe19 req-9a64bb14-87f4-4c67-9514-769e685911a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033314 Apr 12 00:45:49 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 255/757] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:45:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:45:54 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-fe7cc3cc-dda8-4a1e-9342-bffd19396262 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:45:54 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-fe7cc3cc-dda8-4a1e-9342-bffd19396262 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:45:54 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fe7cc3cc-dda8-4a1e-9342-bffd19396262 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:54 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fe7cc3cc-dda8-4a1e-9342-bffd19396262 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:54 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fe7cc3cc-dda8-4a1e-9342-bffd19396262 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:54 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fe7cc3cc-dda8-4a1e-9342-bffd19396262 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:54 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fe7cc3cc-dda8-4a1e-9342-bffd19396262 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:54 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fe7cc3cc-dda8-4a1e-9342-bffd19396262 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:55 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-fe7cc3cc-dda8-4a1e-9342-bffd19396262 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:45:55 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-fe7cc3cc-dda8-4a1e-9342-bffd19396262 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5d898c2-8548-4b32-829e-6afa11e1985f" status: 200 len: 1442 microversion: 2.1 time: 0.148354 Apr 12 00:45:55 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 253/758] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:45:54 2023] GET /compute/v2.1/servers/e5d898c2-8548-4b32-829e-6afa11e1985f => generated 1442 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:45:56 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-7a31afc8-c496-4fa9-bd0c-bf77773d8857 req-8d5f3774-43f8-4bf0-91e3-172095cd2d8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d898c2-8548-4b32-829e-6afa11e1985f", "tag": "6578df38-44dd-4f35-943f-b2da72deea5f"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:45:56 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-7a31afc8-c496-4fa9-bd0c-bf77773d8857 req-8d5f3774-43f8-4bf0-91e3-172095cd2d8e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:56 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-7a31afc8-c496-4fa9-bd0c-bf77773d8857 req-8d5f3774-43f8-4bf0-91e3-172095cd2d8e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:56 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-7a31afc8-c496-4fa9-bd0c-bf77773d8857 req-8d5f3774-43f8-4bf0-91e3-172095cd2d8e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:56 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-7a31afc8-c496-4fa9-bd0c-bf77773d8857 req-8d5f3774-43f8-4bf0-91e3-172095cd2d8e service nova] Creating event network-changed:6578df38-44dd-4f35-943f-b2da72deea5f for instance e5d898c2-8548-4b32-829e-6afa11e1985f on user Apr 12 00:45:56 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-7a31afc8-c496-4fa9-bd0c-bf77773d8857 req-8d5f3774-43f8-4bf0-91e3-172095cd2d8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047292 Apr 12 00:45:56 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 251/759] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:45:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:45:57 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:45:57 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:45:57 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-e12c9cdf-a4c9-4b54-85fc-213d64b8e615 req-4bb0c4e6-2e18-45c1-af42-bb8e2afde421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d898c2-8548-4b32-829e-6afa11e1985f", "tag": "6578df38-44dd-4f35-943f-b2da72deea5f"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:45:57 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=13 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:45:57 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:45:57 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:57 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:57 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:57 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:57 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:57 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:57 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-e12c9cdf-a4c9-4b54-85fc-213d64b8e615 req-4bb0c4e6-2e18-45c1-af42-bb8e2afde421 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:57 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-e12c9cdf-a4c9-4b54-85fc-213d64b8e615 req-4bb0c4e6-2e18-45c1-af42-bb8e2afde421 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:57 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-e12c9cdf-a4c9-4b54-85fc-213d64b8e615 req-4bb0c4e6-2e18-45c1-af42-bb8e2afde421 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:57 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=21 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:45:57 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-e12c9cdf-a4c9-4b54-85fc-213d64b8e615 req-4bb0c4e6-2e18-45c1-af42-bb8e2afde421 service nova] Creating event network-changed:6578df38-44dd-4f35-943f-b2da72deea5f for instance e5d898c2-8548-4b32-829e-6afa11e1985f on user Apr 12 00:45:57 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-e12c9cdf-a4c9-4b54-85fc-213d64b8e615 req-4bb0c4e6-2e18-45c1-af42-bb8e2afde421 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034492 Apr 12 00:45:57 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 254/760] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:45:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:45:57 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Going to try to terminate instance {{(pid=72496) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:45:57 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-679b0f3c-0097-4b22-84c1-ec2aba45b90d tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e5d898c2-8548-4b32-829e-6afa11e1985f" status: 204 len: 0 microversion: 2.1 time: 0.133844 Apr 12 00:45:57 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 256/761] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:45:57 2023] DELETE /compute/v2.1/servers/e5d898c2-8548-4b32-829e-6afa11e1985f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:45:57 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-3b598066-8de8-4e3d-80c3-92fc799047f7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:45:57 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-3b598066-8de8-4e3d-80c3-92fc799047f7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:45:57 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-3b598066-8de8-4e3d-80c3-92fc799047f7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:57 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-3b598066-8de8-4e3d-80c3-92fc799047f7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:57 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-3b598066-8de8-4e3d-80c3-92fc799047f7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:57 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-3b598066-8de8-4e3d-80c3-92fc799047f7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:57 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-3b598066-8de8-4e3d-80c3-92fc799047f7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:57 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-3b598066-8de8-4e3d-80c3-92fc799047f7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:57 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-3b598066-8de8-4e3d-80c3-92fc799047f7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:45:57 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-3b598066-8de8-4e3d-80c3-92fc799047f7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5d898c2-8548-4b32-829e-6afa11e1985f" status: 200 len: 1566 microversion: 2.1 time: 0.181181 Apr 12 00:45:57 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 252/762] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:45:57 2023] GET /compute/v2.1/servers/e5d898c2-8548-4b32-829e-6afa11e1985f => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:45:57 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-2534ccda-8aa3-42c0-a691-b39dd8e908fb req-f0ab6d69-f8b3-46bb-86ed-8d3e48722f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d898c2-8548-4b32-829e-6afa11e1985f", "name": "network-vif-unplugged", "status": "completed", "tag": "6578df38-44dd-4f35-943f-b2da72deea5f"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:45:57 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-2534ccda-8aa3-42c0-a691-b39dd8e908fb req-f0ab6d69-f8b3-46bb-86ed-8d3e48722f29 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:57 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-2534ccda-8aa3-42c0-a691-b39dd8e908fb req-f0ab6d69-f8b3-46bb-86ed-8d3e48722f29 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:57 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-2534ccda-8aa3-42c0-a691-b39dd8e908fb req-f0ab6d69-f8b3-46bb-86ed-8d3e48722f29 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:57 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-2534ccda-8aa3-42c0-a691-b39dd8e908fb req-f0ab6d69-f8b3-46bb-86ed-8d3e48722f29 service nova] Creating event network-vif-unplugged:6578df38-44dd-4f35-943f-b2da72deea5f for instance e5d898c2-8548-4b32-829e-6afa11e1985f on user Apr 12 00:45:57 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-2534ccda-8aa3-42c0-a691-b39dd8e908fb req-f0ab6d69-f8b3-46bb-86ed-8d3e48722f29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028652 Apr 12 00:45:57 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 255/763] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:45:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:45:59 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-83c9296b-a877-47c2-b640-579efd85ccd1 req-5b747f7d-d816-4073-b3ce-2463b9d7a4ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d898c2-8548-4b32-829e-6afa11e1985f", "name": "network-vif-deleted", "tag": "6578df38-44dd-4f35-943f-b2da72deea5f"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:45:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-83c9296b-a877-47c2-b640-579efd85ccd1 req-5b747f7d-d816-4073-b3ce-2463b9d7a4ab service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-83c9296b-a877-47c2-b640-579efd85ccd1 req-5b747f7d-d816-4073-b3ce-2463b9d7a4ab service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-83c9296b-a877-47c2-b640-579efd85ccd1 req-5b747f7d-d816-4073-b3ce-2463b9d7a4ab service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:59 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-83c9296b-a877-47c2-b640-579efd85ccd1 req-5b747f7d-d816-4073-b3ce-2463b9d7a4ab service nova] Creating event network-vif-deleted:6578df38-44dd-4f35-943f-b2da72deea5f for instance e5d898c2-8548-4b32-829e-6afa11e1985f on user Apr 12 00:45:59 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-83c9296b-a877-47c2-b640-579efd85ccd1 req-5b747f7d-d816-4073-b3ce-2463b9d7a4ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035466 Apr 12 00:45:59 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 257/764] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:45:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:45:59 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-c4db8240-976b-4ecd-8148-5b3940b83a17 req-21cfa908-5d38-4d82-9562-2360fbdd1237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d898c2-8548-4b32-829e-6afa11e1985f", "name": "network-vif-plugged", "status": "completed", "tag": "6578df38-44dd-4f35-943f-b2da72deea5f"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:45:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-c4db8240-976b-4ecd-8148-5b3940b83a17 req-21cfa908-5d38-4d82-9562-2360fbdd1237 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:45:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-c4db8240-976b-4ecd-8148-5b3940b83a17 req-21cfa908-5d38-4d82-9562-2360fbdd1237 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:45:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-c4db8240-976b-4ecd-8148-5b3940b83a17 req-21cfa908-5d38-4d82-9562-2360fbdd1237 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:45:59 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-c4db8240-976b-4ecd-8148-5b3940b83a17 req-21cfa908-5d38-4d82-9562-2360fbdd1237 service nova] Creating event network-vif-plugged:6578df38-44dd-4f35-943f-b2da72deea5f for instance e5d898c2-8548-4b32-829e-6afa11e1985f on user Apr 12 00:45:59 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-c4db8240-976b-4ecd-8148-5b3940b83a17 req-21cfa908-5d38-4d82-9562-2360fbdd1237 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028668 Apr 12 00:45:59 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 253/765] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:45:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:46:00 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-c909de49-c088-4422-b736-e70d84e222e3 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:46:00 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-c909de49-c088-4422-b736-e70d84e222e3 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:46:00 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c909de49-c088-4422-b736-e70d84e222e3 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:00 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c909de49-c088-4422-b736-e70d84e222e3 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:00 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c909de49-c088-4422-b736-e70d84e222e3 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:00 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c909de49-c088-4422-b736-e70d84e222e3 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:00 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c909de49-c088-4422-b736-e70d84e222e3 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:00 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c909de49-c088-4422-b736-e70d84e222e3 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:00 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-c909de49-c088-4422-b736-e70d84e222e3 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:46:00 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-c909de49-c088-4422-b736-e70d84e222e3 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:46:00 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-c909de49-c088-4422-b736-e70d84e222e3 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:46:00 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-c909de49-c088-4422-b736-e70d84e222e3 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0c7ca20-c237-43b0-9a75-2a21392c7fd0" status: 200 len: 1769 microversion: 2.87 time: 0.182778 Apr 12 00:46:00 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 256/766] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:46:00 2023] GET /compute/v2.1/servers/b0c7ca20-c237-43b0-9a75-2a21392c7fd0 => generated 1769 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:46:09 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-380b0dfa-cda0-4342-bd57-3321a9321b8c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:46:09 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-380b0dfa-cda0-4342-bd57-3321a9321b8c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:46:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-380b0dfa-cda0-4342-bd57-3321a9321b8c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-380b0dfa-cda0-4342-bd57-3321a9321b8c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-380b0dfa-cda0-4342-bd57-3321a9321b8c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-380b0dfa-cda0-4342-bd57-3321a9321b8c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-380b0dfa-cda0-4342-bd57-3321a9321b8c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-380b0dfa-cda0-4342-bd57-3321a9321b8c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:09 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-380b0dfa-cda0-4342-bd57-3321a9321b8c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84861eef-6d59-448b-b6b7-eb8dd8e47b30/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.295194 Apr 12 00:46:09 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 258/767] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 00:46:09 2023] GET /compute/v2.1/servers/84861eef-6d59-448b-b6b7-eb8dd8e47b30/os-interface => generated 283 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:46:10 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-8c4d7ce1-f2ec-46ac-8053-d4f43d431a6a req-8752e4a3-a825-42e3-a16e-7a4da15bb356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84861eef-6d59-448b-b6b7-eb8dd8e47b30", "tag": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:46:10 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:46:10 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:46:10 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8c4d7ce1-f2ec-46ac-8053-d4f43d431a6a req-8752e4a3-a825-42e3-a16e-7a4da15bb356 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:10 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8c4d7ce1-f2ec-46ac-8053-d4f43d431a6a req-8752e4a3-a825-42e3-a16e-7a4da15bb356 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:10 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8c4d7ce1-f2ec-46ac-8053-d4f43d431a6a req-8752e4a3-a825-42e3-a16e-7a4da15bb356 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:10 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-8c4d7ce1-f2ec-46ac-8053-d4f43d431a6a req-8752e4a3-a825-42e3-a16e-7a4da15bb356 service nova] Creating event network-changed:df061f79-7574-4b3c-9cf4-2b0e61c5efc1 for instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30 on user Apr 12 00:46:10 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-8c4d7ce1-f2ec-46ac-8053-d4f43d431a6a req-8752e4a3-a825-42e3-a16e-7a4da15bb356 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041554 Apr 12 00:46:10 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 254/768] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:46:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:46:13 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1379829063", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "bb566dde-458e-4ead-a04b-6dbdb540007d"}], "security_groups": [{"name": "tempest-securitygroup--1163846610"}], "key_name": "tempest-keypair-1452487550", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:46:13 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=18 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:46:13 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=7 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:46:13 user devstack@n-api.service[72494]: DEBUG nova.network.neutron [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] validate_networks() for [('bb566dde-458e-4ead-a04b-6dbdb540007d', None, None, None, None, None)] {{(pid=72494) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:46:13 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:46:13 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:46:13 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:46:13 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:46:13 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:46:13 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:13 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:13 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:13 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:13 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:13 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:13 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting quotas for project d8ba626fdf264b879099a89097845153. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:46:13 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting quotas for user d658147b4def4d12a16381d4c19357e3 and project d8ba626fdf264b879099a89097845153. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:46:13 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Going to run 1 instances... {{(pid=72494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:46:13 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cfbc8e6a-8e6f-4323-90c4-190c8c0a39d7',volume_size=None,volume_type=None)] {{(pid=72494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:46:14 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-1887e38e-3244-4683-9a77-de4ca38a14ae tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.787092 Apr 12 00:46:14 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 257/769] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:46:13 2023] POST /compute/v2.1/servers => generated 404 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:46:14 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-f562807d-d7be-42fe-87ba-dba7b5322f63 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:46:14 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-f562807d-d7be-42fe-87ba-dba7b5322f63 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:46:14 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-f562807d-d7be-42fe-87ba-dba7b5322f63 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:46:14 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-f562807d-d7be-42fe-87ba-dba7b5322f63 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749" status: 200 len: 1076 microversion: 2.1 time: 0.065142 Apr 12 00:46:14 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 259/770] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:46:14 2023] GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749 => generated 1076 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 00:46:16 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-3b212b6a-428e-438f-a857-fb86753e2977 req-dc9dcd68-6fa9-4360-875e-cd2fda82d602 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7f4b0ac-f740-46b5-99f1-4129cccf1749", "tag": "6014f3cd-13ce-4fba-9cba-057192db2b3d"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:46:16 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3b212b6a-428e-438f-a857-fb86753e2977 req-dc9dcd68-6fa9-4360-875e-cd2fda82d602 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:16 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3b212b6a-428e-438f-a857-fb86753e2977 req-dc9dcd68-6fa9-4360-875e-cd2fda82d602 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:16 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3b212b6a-428e-438f-a857-fb86753e2977 req-dc9dcd68-6fa9-4360-875e-cd2fda82d602 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:16 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-3b212b6a-428e-438f-a857-fb86753e2977 req-dc9dcd68-6fa9-4360-875e-cd2fda82d602 service nova] Creating event network-changed:6014f3cd-13ce-4fba-9cba-057192db2b3d for instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 on user Apr 12 00:46:16 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-3b212b6a-428e-438f-a857-fb86753e2977 req-dc9dcd68-6fa9-4360-875e-cd2fda82d602 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028299 Apr 12 00:46:16 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 255/771] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:46:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:46:18 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-550203c0-e81e-4fff-8681-cce7cea8e12a tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:46:18 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-550203c0-e81e-4fff-8681-cce7cea8e12a tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:46:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-550203c0-e81e-4fff-8681-cce7cea8e12a tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-550203c0-e81e-4fff-8681-cce7cea8e12a tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-550203c0-e81e-4fff-8681-cce7cea8e12a tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-550203c0-e81e-4fff-8681-cce7cea8e12a tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-550203c0-e81e-4fff-8681-cce7cea8e12a tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-550203c0-e81e-4fff-8681-cce7cea8e12a tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:18 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-550203c0-e81e-4fff-8681-cce7cea8e12a tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.094716 Apr 12 00:46:18 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 258/772] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 00:46:18 2023] GET /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7/os-interface => generated 282 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:46:19 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-7447b69e-58ee-4d74-90c7-abe1500f3ae6 req-22b70ecb-4458-4af2-9290-5f57c7f1246a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a346a131-2502-457a-acb8-8f903a7b87a7", "tag": "9457e7d7-925c-4488-bb2d-c3019a663c42"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:46:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-7447b69e-58ee-4d74-90c7-abe1500f3ae6 req-22b70ecb-4458-4af2-9290-5f57c7f1246a service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-7447b69e-58ee-4d74-90c7-abe1500f3ae6 req-22b70ecb-4458-4af2-9290-5f57c7f1246a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-7447b69e-58ee-4d74-90c7-abe1500f3ae6 req-22b70ecb-4458-4af2-9290-5f57c7f1246a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:19 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-7447b69e-58ee-4d74-90c7-abe1500f3ae6 req-22b70ecb-4458-4af2-9290-5f57c7f1246a service nova] Creating event network-changed:9457e7d7-925c-4488-bb2d-c3019a663c42 for instance a346a131-2502-457a-acb8-8f903a7b87a7 on user Apr 12 00:46:19 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-7447b69e-58ee-4d74-90c7-abe1500f3ae6 req-22b70ecb-4458-4af2-9290-5f57c7f1246a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028369 Apr 12 00:46:19 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 260/773] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:46:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:46:19 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-854477f8-34d3-40d2-ba2e-ff9c67b575c9 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:46:19 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-854477f8-34d3-40d2-ba2e-ff9c67b575c9 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:46:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-854477f8-34d3-40d2-ba2e-ff9c67b575c9 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-854477f8-34d3-40d2-ba2e-ff9c67b575c9 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-854477f8-34d3-40d2-ba2e-ff9c67b575c9 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-854477f8-34d3-40d2-ba2e-ff9c67b575c9 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-854477f8-34d3-40d2-ba2e-ff9c67b575c9 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-854477f8-34d3-40d2-ba2e-ff9c67b575c9 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:19 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-854477f8-34d3-40d2-ba2e-ff9c67b575c9 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7/ips" status: 200 len: 108 microversion: 2.1 time: 0.042979 Apr 12 00:46:19 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 256/774] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 00:46:19 2023] GET /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7/ips => generated 108 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:46:20 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e372d117-4889-4cbc-8b8c-f8955dcea7be"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:46:20 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:46:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:20 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-d28472c1-f0ce-427f-9c2a-5c744d8a530e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269800 Apr 12 00:46:20 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 259/775] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 00:46:20 2023] POST /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:46:22 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-1e063e34-8df6-43b6-b0d3-a45e84aa9a93 req-76164e4f-cac1-4b27-8c46-d4d407ed50f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f4b0ac-f740-46b5-99f1-4129cccf1749", "name": "network-vif-plugged", "status": "completed", "tag": "6014f3cd-13ce-4fba-9cba-057192db2b3d"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:46:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-1e063e34-8df6-43b6-b0d3-a45e84aa9a93 req-76164e4f-cac1-4b27-8c46-d4d407ed50f7 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-1e063e34-8df6-43b6-b0d3-a45e84aa9a93 req-76164e4f-cac1-4b27-8c46-d4d407ed50f7 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-1e063e34-8df6-43b6-b0d3-a45e84aa9a93 req-76164e4f-cac1-4b27-8c46-d4d407ed50f7 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:22 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-1e063e34-8df6-43b6-b0d3-a45e84aa9a93 req-76164e4f-cac1-4b27-8c46-d4d407ed50f7 service nova] Creating event network-vif-plugged:6014f3cd-13ce-4fba-9cba-057192db2b3d for instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 on user Apr 12 00:46:22 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-1e063e34-8df6-43b6-b0d3-a45e84aa9a93 req-76164e4f-cac1-4b27-8c46-d4d407ed50f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051186 Apr 12 00:46:22 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 261/776] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:46:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:46:25 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-3fe26879-e5b0-4ed5-95b5-a725184142ec req-95f2029c-87d9-499b-a0cb-987013dfe190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f4b0ac-f740-46b5-99f1-4129cccf1749", "name": "network-vif-plugged", "status": "completed", "tag": "6014f3cd-13ce-4fba-9cba-057192db2b3d"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:46:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3fe26879-e5b0-4ed5-95b5-a725184142ec req-95f2029c-87d9-499b-a0cb-987013dfe190 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3fe26879-e5b0-4ed5-95b5-a725184142ec req-95f2029c-87d9-499b-a0cb-987013dfe190 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3fe26879-e5b0-4ed5-95b5-a725184142ec req-95f2029c-87d9-499b-a0cb-987013dfe190 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:25 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-3fe26879-e5b0-4ed5-95b5-a725184142ec req-95f2029c-87d9-499b-a0cb-987013dfe190 service nova] Creating event network-vif-plugged:6014f3cd-13ce-4fba-9cba-057192db2b3d for instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 on user Apr 12 00:46:25 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-3fe26879-e5b0-4ed5-95b5-a725184142ec req-95f2029c-87d9-499b-a0cb-987013dfe190 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028051 Apr 12 00:46:25 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 257/777] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:46:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:46:25 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:46:25 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=6 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:46:25 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-c920aa8d-d774-47c5-a3e0-6a70829dc299 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:46:25 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-c920aa8d-d774-47c5-a3e0-6a70829dc299 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: c57eddf0-bf85-4b87-a352-57508a728763] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:46:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c920aa8d-d774-47c5-a3e0-6a70829dc299 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c920aa8d-d774-47c5-a3e0-6a70829dc299 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c920aa8d-d774-47c5-a3e0-6a70829dc299 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c920aa8d-d774-47c5-a3e0-6a70829dc299 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c920aa8d-d774-47c5-a3e0-6a70829dc299 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c920aa8d-d774-47c5-a3e0-6a70829dc299 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:25 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-c920aa8d-d774-47c5-a3e0-6a70829dc299 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] HTTP exception thrown: Instance c57eddf0-bf85-4b87-a352-57508a728763 could not be found. Apr 12 00:46:25 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-c920aa8d-d774-47c5-a3e0-6a70829dc299 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Request method failure captured: Apr 12 00:46:25 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763 HTTP/1.1 Apr 12 00:46:25 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:46:25 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:46:25 user devstack@n-api.service[72494]: Connection: close Apr 12 00:46:25 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:46:25 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:46:25 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:46:25 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:46:25 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:46:25 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNf3_MXW68YWDhh4rdV6_s09Iac6VOPtMLVWpm0rGO_C1gJPbOzQvz6QNsDKExkr7tGyCe2GBMnyNIMBwvCofPc3o4pLjUWgkRI5V8Er_kr32XrEVpmyBXrjPzBF9_uy3WkbWoMTIlSDlSkI30Lw-qDUV_rwBUVs6oI9KWkfrbr0SVjY Apr 12 00:46:25 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:46:25 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:46:25 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:46:25 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:46:25 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:46:25 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:46:25 user devstack@n-api.service[72494]: X-Project-Id: e66fda80cb83402392e155c76ee78e1f Apr 12 00:46:25 user devstack@n-api.service[72494]: X-Project-Name: tempest-TestMinimumBasicScenario-1682364358 Apr 12 00:46:25 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:46:25 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:46:25 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e66fda80cb83402392e155c76ee78e1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e66fda80cb83402392e155c76ee78e1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e66fda80cb83402392e155c76ee78e1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:46:25 user devstack@n-api.service[72494]: X-Tenant: tempest-TestMinimumBasicScenario-1682364358 Apr 12 00:46:25 user devstack@n-api.service[72494]: X-Tenant-Id: e66fda80cb83402392e155c76ee78e1f Apr 12 00:46:25 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1682364358 Apr 12 00:46:25 user devstack@n-api.service[72494]: X-User: tempest-TestMinimumBasicScenario-1682364358-project-member Apr 12 00:46:25 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:46:25 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:46:25 user devstack@n-api.service[72494]: X-User-Id: 2842535891eb4a9880f7e8859dd0de3c Apr 12 00:46:25 user devstack@n-api.service[72494]: X-User-Name: tempest-TestMinimumBasicScenario-1682364358-project-member Apr 12 00:46:25 user devstack@n-api.service[72494]: method: > Apr 12 00:46:25 user devstack@n-api.service[72494]: exception: Instance c57eddf0-bf85-4b87-a352-57508a728763 could not be found. Apr 12 00:46:25 user devstack@n-api.service[72494]: action_args: {'id': 'c57eddf0-bf85-4b87-a352-57508a728763'} Apr 12 00:46:25 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c57eddf0-bf85-4b87-a352-57508a728763 could not be found. Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c57eddf0-bf85-4b87-a352-57508a728763 could not be found. Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c57eddf0-bf85-4b87-a352-57508a728763 could not be found. Apr 12 00:46:25 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:46:25 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-c920aa8d-d774-47c5-a3e0-6a70829dc299 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Returning 404 to user: Instance c57eddf0-bf85-4b87-a352-57508a728763 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:46:25 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-c920aa8d-d774-47c5-a3e0-6a70829dc299 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763" status: 404 len: 111 microversion: 2.1 time: 0.153702 Apr 12 00:46:25 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 260/778] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:46:25 2023] GET /compute/v2.1/servers/c57eddf0-bf85-4b87-a352-57508a728763 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 00:46:25 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:46:25 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-4f871f52-b1fa-4f9c-859d-d05df14df149 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '.version_select at 0x7f7cd47cf2e0>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:46:25 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-4f871f52-b1fa-4f9c-859d-d05df14df149 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1878126979" status: 202 len: 0 microversion: 2.1 time: 0.029406 Apr 12 00:46:25 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 262/779] 10.0.0.210 () {62 vars in 1349 bytes} [Wed Apr 12 00:46:25 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1878126979 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 00:46:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-3be46ee0-abde-4843-97af-33782c169507 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Action: 'create', calling method: .version_select at 0x7f7cd4548040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-609117724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKUjMUHJg1ZJrVvMP4uF5S0HHA87ZxyaAz9hfCYZiiiib71m38Sm7mvxr0QpYkB8Gavhzox7dRsXgcBgTh+Oh0K1TRPHl0cUmphSvbOmnIOmcwihIPv00AoperWHPnpYQ=="}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:46:27 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-3be46ee0-abde-4843-97af-33782c169507 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Getting quotas for project e66fda80cb83402392e155c76ee78e1f. Resources: {'key_pairs'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:46:27 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-3be46ee0-abde-4843-97af-33782c169507 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Getting quotas for user 2842535891eb4a9880f7e8859dd0de3c and project e66fda80cb83402392e155c76ee78e1f. Resources: {'key_pairs'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:46:27 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-3be46ee0-abde-4843-97af-33782c169507 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052547 Apr 12 00:46:27 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 258/780] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 00:46:27 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:46:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-381148789", "imageRef": "31461e92-139a-4213-a81b-97f686de3b0e", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-609117724", "networks": [{"uuid": "f0cb3c70-3fb7-45b5-8454-846b0c4b7a86"}]}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:46:28 user devstack@n-api.service[72494]: DEBUG nova.network.neutron [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] validate_networks() for [('f0cb3c70-3fb7-45b5-8454-846b0c4b7a86', None, None, None, None, None)] {{(pid=72494) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:46:28 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Flavor limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:46:28 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Image limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:46:28 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Flavor pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:46:28 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Image pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:46:28 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:46:28 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:28 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:28 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:28 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:28 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:28 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:28 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Getting quotas for project e66fda80cb83402392e155c76ee78e1f. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:46:28 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Getting quotas for user 2842535891eb4a9880f7e8859dd0de3c and project e66fda80cb83402392e155c76ee78e1f. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:46:28 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Going to run 1 instances... {{(pid=72494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:46:28 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='31461e92-139a-4213-a81b-97f686de3b0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:46:28 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-72f30698-0a39-47f9-b3f1-956e50996acd tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.516490 Apr 12 00:46:28 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 261/781] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:46:27 2023] POST /compute/v2.1/servers => generated 378 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:46:28 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-8feeba4e-77a2-4a29-ab06-bab2c16d9a2f tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:46:28 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-8feeba4e-77a2-4a29-ab06-bab2c16d9a2f tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:46:28 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:46:28 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:46:28 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:46:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:28 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-8feeba4e-77a2-4a29-ab06-bab2c16d9a2f tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842535891eb4a9880f7e8859dd0de3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66fda80cb83402392e155c76ee78e1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:46:28 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-8feeba4e-77a2-4a29-ab06-bab2c16d9a2f tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90" status: 200 len: 1251 microversion: 2.1 time: 0.066711 Apr 12 00:46:28 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 263/782] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:46:28 2023] GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90 => generated 1251 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:46:28 user devstack@n-api.service[72495]: DEBUG nova.objects.instance [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lazy-loading 'services' on Instance uuid a346a131-2502-457a-acb8-8f903a7b87a7 {{(pid=72495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:46:28 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-84095507-5f83-4a9e-bd4e-f5607064a813 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7/os-volume_attachments/e372d117-4889-4cbc-8b8c-f8955dcea7be" status: 202 len: 0 microversion: 2.1 time: 0.263108 Apr 12 00:46:28 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 259/783] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 00:46:28 2023] DELETE /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7/os-volume_attachments/e372d117-4889-4cbc-8b8c-f8955dcea7be => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:46:28 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-a5b7c99e-1f8d-43fa-b6b9-2a3cba253332 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:46:28 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-a5b7c99e-1f8d-43fa-b6b9-2a3cba253332 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:46:28 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a5b7c99e-1f8d-43fa-b6b9-2a3cba253332 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:28 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a5b7c99e-1f8d-43fa-b6b9-2a3cba253332 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:28 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a5b7c99e-1f8d-43fa-b6b9-2a3cba253332 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:28 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a5b7c99e-1f8d-43fa-b6b9-2a3cba253332 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:28 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a5b7c99e-1f8d-43fa-b6b9-2a3cba253332 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:28 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a5b7c99e-1f8d-43fa-b6b9-2a3cba253332 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:28 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-a5b7c99e-1f8d-43fa-b6b9-2a3cba253332 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048621 Apr 12 00:46:28 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 262/784] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:46:28 2023] GET /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:46:31 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-b7e34fd4-3de9-40e2-9365-0b9ee1b7bf08 req-25274c5d-7941-4053-a691-9db9e12ea722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fdb2b97-85b9-4e15-b586-948c3804da90", "tag": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:46:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-b7e34fd4-3de9-40e2-9365-0b9ee1b7bf08 req-25274c5d-7941-4053-a691-9db9e12ea722 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-b7e34fd4-3de9-40e2-9365-0b9ee1b7bf08 req-25274c5d-7941-4053-a691-9db9e12ea722 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-b7e34fd4-3de9-40e2-9365-0b9ee1b7bf08 req-25274c5d-7941-4053-a691-9db9e12ea722 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:31 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:46:31 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-b7e34fd4-3de9-40e2-9365-0b9ee1b7bf08 req-25274c5d-7941-4053-a691-9db9e12ea722 service nova] Creating event network-changed:b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance 1fdb2b97-85b9-4e15-b586-948c3804da90 on user Apr 12 00:46:31 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-b7e34fd4-3de9-40e2-9365-0b9ee1b7bf08 req-25274c5d-7941-4053-a691-9db9e12ea722 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029517 Apr 12 00:46:31 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 264/785] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:46:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:46:33 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-decb7a6f-9d91-4214-90cd-aca8e8598ae6 req-c141a520-d15e-49be-8eba-988b842f2273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fdb2b97-85b9-4e15-b586-948c3804da90", "name": "network-vif-plugged", "status": "completed", "tag": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:46:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-decb7a6f-9d91-4214-90cd-aca8e8598ae6 req-c141a520-d15e-49be-8eba-988b842f2273 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-decb7a6f-9d91-4214-90cd-aca8e8598ae6 req-c141a520-d15e-49be-8eba-988b842f2273 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-decb7a6f-9d91-4214-90cd-aca8e8598ae6 req-c141a520-d15e-49be-8eba-988b842f2273 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:33 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-decb7a6f-9d91-4214-90cd-aca8e8598ae6 req-c141a520-d15e-49be-8eba-988b842f2273 service nova] Creating event network-vif-plugged:b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance 1fdb2b97-85b9-4e15-b586-948c3804da90 on user Apr 12 00:46:33 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-decb7a6f-9d91-4214-90cd-aca8e8598ae6 req-c141a520-d15e-49be-8eba-988b842f2273 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030877 Apr 12 00:46:33 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 260/786] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:46:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:46:35 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-7e25e570-1cf0-466a-81f2-9b22cc11c0ec req-6e2182f8-d1af-4318-b35d-1f41fb7b19fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fdb2b97-85b9-4e15-b586-948c3804da90", "name": "network-vif-plugged", "status": "completed", "tag": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:46:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-7e25e570-1cf0-466a-81f2-9b22cc11c0ec req-6e2182f8-d1af-4318-b35d-1f41fb7b19fc service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-7e25e570-1cf0-466a-81f2-9b22cc11c0ec req-6e2182f8-d1af-4318-b35d-1f41fb7b19fc service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-7e25e570-1cf0-466a-81f2-9b22cc11c0ec req-6e2182f8-d1af-4318-b35d-1f41fb7b19fc service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:35 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-7e25e570-1cf0-466a-81f2-9b22cc11c0ec req-6e2182f8-d1af-4318-b35d-1f41fb7b19fc service nova] Creating event network-vif-plugged:b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance 1fdb2b97-85b9-4e15-b586-948c3804da90 on user Apr 12 00:46:35 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-7e25e570-1cf0-466a-81f2-9b22cc11c0ec req-6e2182f8-d1af-4318-b35d-1f41fb7b19fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035196 Apr 12 00:46:35 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 263/787] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:46:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:46:37 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-627c4440-64f9-4adc-9cfb-15f9dd22bef5 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:46:37 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-627c4440-64f9-4adc-9cfb-15f9dd22bef5 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:46:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-627c4440-64f9-4adc-9cfb-15f9dd22bef5 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-627c4440-64f9-4adc-9cfb-15f9dd22bef5 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-627c4440-64f9-4adc-9cfb-15f9dd22bef5 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-627c4440-64f9-4adc-9cfb-15f9dd22bef5 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-627c4440-64f9-4adc-9cfb-15f9dd22bef5 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-627c4440-64f9-4adc-9cfb-15f9dd22bef5 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:37 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-627c4440-64f9-4adc-9cfb-15f9dd22bef5 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] HTTP exception thrown: Instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 could not be found. Apr 12 00:46:37 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-627c4440-64f9-4adc-9cfb-15f9dd22bef5 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Request method failure captured: Apr 12 00:46:37 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 HTTP/1.1 Apr 12 00:46:37 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:46:37 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:46:37 user devstack@n-api.service[72496]: Connection: close Apr 12 00:46:37 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:46:37 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:46:37 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:46:37 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:46:37 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:46:37 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNft5KIxwEgdwTqD-CgWzQHRf_FoqYilC4_z8sLEvoXo1R3M7HNE1MMy-1-GlWM0X8BruNgg2BCXLv_-0_S4kRyGh3lOQ6Sb9IfuhvN2rkuUyf5ySkxhKP32iNzWpbdPq8mfldEe_U0xhj5wtI02KiYIEO-zb6pTaOupaX4Sx0JOImss Apr 12 00:46:37 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:46:37 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:46:37 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:46:37 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:46:37 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:46:37 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:46:37 user devstack@n-api.service[72496]: X-Project-Id: fcf1fea74ef143e6b394e41e7c4ed495 Apr 12 00:46:37 user devstack@n-api.service[72496]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1300870234 Apr 12 00:46:37 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:46:37 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:46:37 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fcf1fea74ef143e6b394e41e7c4ed495"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fcf1fea74ef143e6b394e41e7c4ed495"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fcf1fea74ef143e6b394e41e7c4ed495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:46:37 user devstack@n-api.service[72496]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1300870234 Apr 12 00:46:37 user devstack@n-api.service[72496]: X-Tenant-Id: fcf1fea74ef143e6b394e41e7c4ed495 Apr 12 00:46:37 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1300870234 Apr 12 00:46:37 user devstack@n-api.service[72496]: X-User: tempest-ServerRescueNegativeTestJSON-1300870234-project-member Apr 12 00:46:37 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:46:37 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:46:37 user devstack@n-api.service[72496]: X-User-Id: 6b9421443b2f421298a934122c6a8b8c Apr 12 00:46:37 user devstack@n-api.service[72496]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1300870234-project-member Apr 12 00:46:37 user devstack@n-api.service[72496]: method: > Apr 12 00:46:37 user devstack@n-api.service[72496]: exception: Instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 could not be found. Apr 12 00:46:37 user devstack@n-api.service[72496]: action_args: {'id': '0334c8b1-3d0e-4af5-b86f-a6b41a3d6050'} Apr 12 00:46:37 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 could not be found. Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 could not be found. Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 could not be found. Apr 12 00:46:37 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:46:37 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-627c4440-64f9-4adc-9cfb-15f9dd22bef5 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Returning 404 to user: Instance 0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:46:37 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-627c4440-64f9-4adc-9cfb-15f9dd22bef5 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050" status: 404 len: 111 microversion: 2.1 time: 0.152135 Apr 12 00:46:37 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 265/788] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:46:36 2023] GET /compute/v2.1/servers/0334c8b1-3d0e-4af5-b86f-a6b41a3d6050 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:46:37 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:46:37 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:46:37 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:37 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:37 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:37 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:37 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:37 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:37 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Going to try to terminate instance {{(pid=72495) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:46:37 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-8402231e-6f1e-4217-919b-7086b32a5c94 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0" status: 204 len: 0 microversion: 2.1 time: 0.135482 Apr 12 00:46:37 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 261/789] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:46:37 2023] DELETE /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 12 00:46:37 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-83576469-b3a2-48c7-a4ae-b4cf36a96bc2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:46:37 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-83576469-b3a2-48c7-a4ae-b4cf36a96bc2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:46:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-83576469-b3a2-48c7-a4ae-b4cf36a96bc2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-83576469-b3a2-48c7-a4ae-b4cf36a96bc2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-83576469-b3a2-48c7-a4ae-b4cf36a96bc2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-83576469-b3a2-48c7-a4ae-b4cf36a96bc2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-83576469-b3a2-48c7-a4ae-b4cf36a96bc2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-83576469-b3a2-48c7-a4ae-b4cf36a96bc2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:37 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-83576469-b3a2-48c7-a4ae-b4cf36a96bc2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b9421443b2f421298a934122c6a8b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf1fea74ef143e6b394e41e7c4ed495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:46:37 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-83576469-b3a2-48c7-a4ae-b4cf36a96bc2 tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0" status: 200 len: 1509 microversion: 2.1 time: 0.204992 Apr 12 00:46:37 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 264/790] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:46:37 2023] GET /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0 => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:46:37 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-7485362c-6fe4-4055-9a76-abc24bf6909c req-00f9477c-ef39-4fc6-8bcb-0a8bc393aadd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d895d64-319f-4c67-8c20-ef0d0437a1f0", "name": "network-vif-unplugged", "status": "completed", "tag": "e92d06cb-6535-4389-b328-57add5f4f812"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:46:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-7485362c-6fe4-4055-9a76-abc24bf6909c req-00f9477c-ef39-4fc6-8bcb-0a8bc393aadd service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-7485362c-6fe4-4055-9a76-abc24bf6909c req-00f9477c-ef39-4fc6-8bcb-0a8bc393aadd service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-7485362c-6fe4-4055-9a76-abc24bf6909c req-00f9477c-ef39-4fc6-8bcb-0a8bc393aadd service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:37 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-7485362c-6fe4-4055-9a76-abc24bf6909c req-00f9477c-ef39-4fc6-8bcb-0a8bc393aadd service nova] Creating event network-vif-unplugged:e92d06cb-6535-4389-b328-57add5f4f812 for instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 on user Apr 12 00:46:37 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-7485362c-6fe4-4055-9a76-abc24bf6909c req-00f9477c-ef39-4fc6-8bcb-0a8bc393aadd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061946 Apr 12 00:46:37 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 266/791] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:46:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:46:38 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-29911d06-91b8-4e4c-8d2d-1c8a8cbae069 req-daa875c3-71ab-4cda-9499-c0ee0d88b203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d895d64-319f-4c67-8c20-ef0d0437a1f0", "name": "network-vif-deleted", "tag": "e92d06cb-6535-4389-b328-57add5f4f812"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:46:38 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:46:38 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-29911d06-91b8-4e4c-8d2d-1c8a8cbae069 req-daa875c3-71ab-4cda-9499-c0ee0d88b203 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:38 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-29911d06-91b8-4e4c-8d2d-1c8a8cbae069 req-daa875c3-71ab-4cda-9499-c0ee0d88b203 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:38 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-29911d06-91b8-4e4c-8d2d-1c8a8cbae069 req-daa875c3-71ab-4cda-9499-c0ee0d88b203 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:38 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-29911d06-91b8-4e4c-8d2d-1c8a8cbae069 req-daa875c3-71ab-4cda-9499-c0ee0d88b203 service nova] Creating event network-vif-deleted:e92d06cb-6535-4389-b328-57add5f4f812 for instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 on user Apr 12 00:46:38 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-29911d06-91b8-4e4c-8d2d-1c8a8cbae069 req-daa875c3-71ab-4cda-9499-c0ee0d88b203 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044786 Apr 12 00:46:38 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 262/792] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:46:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:46:39 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:46:39 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=6 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:46:39 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-dca51d9a-80d1-44ce-9fa9-6d6e0b82e913 req-55445d89-3e50-45dc-a3f2-f5af9601de43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d895d64-319f-4c67-8c20-ef0d0437a1f0", "name": "network-vif-plugged", "status": "completed", "tag": "e92d06cb-6535-4389-b328-57add5f4f812"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:46:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-dca51d9a-80d1-44ce-9fa9-6d6e0b82e913 req-55445d89-3e50-45dc-a3f2-f5af9601de43 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-dca51d9a-80d1-44ce-9fa9-6d6e0b82e913 req-55445d89-3e50-45dc-a3f2-f5af9601de43 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-dca51d9a-80d1-44ce-9fa9-6d6e0b82e913 req-55445d89-3e50-45dc-a3f2-f5af9601de43 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:39 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-dca51d9a-80d1-44ce-9fa9-6d6e0b82e913 req-55445d89-3e50-45dc-a3f2-f5af9601de43 service nova] Creating event network-vif-plugged:e92d06cb-6535-4389-b328-57add5f4f812 for instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 on user Apr 12 00:46:39 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-dca51d9a-80d1-44ce-9fa9-6d6e0b82e913 req-55445d89-3e50-45dc-a3f2-f5af9601de43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033646 Apr 12 00:46:39 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 265/793] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:46:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:46:47 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:46:47 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=9 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:46:47 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=5 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:46:47 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-825cd4d2-8864-4f6a-a036-e2f8cfec74fe tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:46:47 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-825cd4d2-8864-4f6a-a036-e2f8cfec74fe tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: e5d898c2-8548-4b32-829e-6afa11e1985f] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:46:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-825cd4d2-8864-4f6a-a036-e2f8cfec74fe tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-825cd4d2-8864-4f6a-a036-e2f8cfec74fe tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-825cd4d2-8864-4f6a-a036-e2f8cfec74fe tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-825cd4d2-8864-4f6a-a036-e2f8cfec74fe tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-825cd4d2-8864-4f6a-a036-e2f8cfec74fe tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-825cd4d2-8864-4f6a-a036-e2f8cfec74fe tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:47 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-825cd4d2-8864-4f6a-a036-e2f8cfec74fe tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] HTTP exception thrown: Instance e5d898c2-8548-4b32-829e-6afa11e1985f could not be found. Apr 12 00:46:47 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-825cd4d2-8864-4f6a-a036-e2f8cfec74fe tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Request method failure captured: Apr 12 00:46:47 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/e5d898c2-8548-4b32-829e-6afa11e1985f HTTP/1.1 Apr 12 00:46:47 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:46:47 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:46:47 user devstack@n-api.service[72496]: Connection: close Apr 12 00:46:47 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:46:47 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:46:47 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:46:47 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:46:47 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:46:47 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNfut1jPVwgpnHF2p4IDb8mw8QCnmrhPi1bglXERi9o-oc8KfA86Nj8qbMXqGPJ-Qu-hg1buox-hKkUkiuJLGP2TjR-hKqepkY3sMZyNoxK3mS9Lgsu4E_4fnuzEqTUjrpCZSmbPFt9R2omKh-uhIkWfp0X1fr8C_wHlflXHVBJsAvYQ Apr 12 00:46:47 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:46:47 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:46:47 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:46:47 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:46:47 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:46:47 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:46:47 user devstack@n-api.service[72496]: X-Project-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:46:47 user devstack@n-api.service[72496]: X-Project-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:46:47 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:46:47 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:46:47 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:46:47 user devstack@n-api.service[72496]: X-Tenant: tempest-TestVolumeBootPattern-726466832 Apr 12 00:46:47 user devstack@n-api.service[72496]: X-Tenant-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:46:47 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:46:47 user devstack@n-api.service[72496]: X-User: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:46:47 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:46:47 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:46:47 user devstack@n-api.service[72496]: X-User-Id: c479f6ae2f0d40908be9b07717ca3509 Apr 12 00:46:47 user devstack@n-api.service[72496]: X-User-Name: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:46:47 user devstack@n-api.service[72496]: method: > Apr 12 00:46:47 user devstack@n-api.service[72496]: exception: Instance e5d898c2-8548-4b32-829e-6afa11e1985f could not be found. Apr 12 00:46:47 user devstack@n-api.service[72496]: action_args: {'id': 'e5d898c2-8548-4b32-829e-6afa11e1985f'} Apr 12 00:46:47 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d898c2-8548-4b32-829e-6afa11e1985f could not be found. Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d898c2-8548-4b32-829e-6afa11e1985f could not be found. Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d898c2-8548-4b32-829e-6afa11e1985f could not be found. Apr 12 00:46:47 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:46:47 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-825cd4d2-8864-4f6a-a036-e2f8cfec74fe tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Returning 404 to user: Instance e5d898c2-8548-4b32-829e-6afa11e1985f could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:46:47 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-825cd4d2-8864-4f6a-a036-e2f8cfec74fe tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5d898c2-8548-4b32-829e-6afa11e1985f" status: 404 len: 111 microversion: 2.1 time: 0.132048 Apr 12 00:46:47 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 267/794] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:46:47 2023] GET /compute/v2.1/servers/e5d898c2-8548-4b32-829e-6afa11e1985f => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:46:50 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:46:50 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:46:50 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=6 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:46:50 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:46:50 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:46:50 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=38,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:46:50 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-0b07fded-468e-4bd9-83a2-9c80909bfbff req-b9ad3cb8-414c-4410-b0b2-98b40b38d231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "533174dc-5071-487b-9a2c-74cd7786af8a", "tag": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:46:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-0b07fded-468e-4bd9-83a2-9c80909bfbff req-b9ad3cb8-414c-4410-b0b2-98b40b38d231 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-0b07fded-468e-4bd9-83a2-9c80909bfbff req-b9ad3cb8-414c-4410-b0b2-98b40b38d231 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-0b07fded-468e-4bd9-83a2-9c80909bfbff req-b9ad3cb8-414c-4410-b0b2-98b40b38d231 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:50 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-0b07fded-468e-4bd9-83a2-9c80909bfbff req-b9ad3cb8-414c-4410-b0b2-98b40b38d231 service nova] Creating event network-changed:d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 for instance 533174dc-5071-487b-9a2c-74cd7786af8a on user Apr 12 00:46:50 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-0b07fded-468e-4bd9-83a2-9c80909bfbff req-b9ad3cb8-414c-4410-b0b2-98b40b38d231 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036518 Apr 12 00:46:50 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 266/795] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:46:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:46:50 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Going to try to terminate instance {{(pid=72495) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:46:50 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-8c468f38-a95b-4197-b7d0-6db8bafb4c2f tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/533174dc-5071-487b-9a2c-74cd7786af8a" status: 204 len: 0 microversion: 2.1 time: 0.125346 Apr 12 00:46:50 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 263/796] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:46:50 2023] DELETE /compute/v2.1/servers/533174dc-5071-487b-9a2c-74cd7786af8a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:46:50 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-60301b9e-f584-45f9-abe3-c14233ccbc7b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:46:50 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-60301b9e-f584-45f9-abe3-c14233ccbc7b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:46:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-60301b9e-f584-45f9-abe3-c14233ccbc7b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-60301b9e-f584-45f9-abe3-c14233ccbc7b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-60301b9e-f584-45f9-abe3-c14233ccbc7b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-60301b9e-f584-45f9-abe3-c14233ccbc7b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-60301b9e-f584-45f9-abe3-c14233ccbc7b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-60301b9e-f584-45f9-abe3-c14233ccbc7b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:50 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-60301b9e-f584-45f9-abe3-c14233ccbc7b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c479f6ae2f0d40908be9b07717ca3509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e38a98bf1d964ee6bd2d0d05e97a283a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:46:50 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-60301b9e-f584-45f9-abe3-c14233ccbc7b tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/533174dc-5071-487b-9a2c-74cd7786af8a" status: 200 len: 1566 microversion: 2.1 time: 0.176242 Apr 12 00:46:50 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 268/797] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:46:50 2023] GET /compute/v2.1/servers/533174dc-5071-487b-9a2c-74cd7786af8a => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:46:52 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-cbbdeb6f-e58a-4908-9023-f7beb4434084 req-651f2f38-f63a-4e2c-a440-5631e022a615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "533174dc-5071-487b-9a2c-74cd7786af8a", "name": "network-vif-deleted", "tag": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:46:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-cbbdeb6f-e58a-4908-9023-f7beb4434084 req-651f2f38-f63a-4e2c-a440-5631e022a615 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-cbbdeb6f-e58a-4908-9023-f7beb4434084 req-651f2f38-f63a-4e2c-a440-5631e022a615 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-cbbdeb6f-e58a-4908-9023-f7beb4434084 req-651f2f38-f63a-4e2c-a440-5631e022a615 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:52 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-cbbdeb6f-e58a-4908-9023-f7beb4434084 req-651f2f38-f63a-4e2c-a440-5631e022a615 service nova] Creating event network-vif-deleted:d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 for instance 533174dc-5071-487b-9a2c-74cd7786af8a on user Apr 12 00:46:52 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-cbbdeb6f-e58a-4908-9023-f7beb4434084 req-651f2f38-f63a-4e2c-a440-5631e022a615 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034248 Apr 12 00:46:52 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 267/798] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:46:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:46:52 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-88bb8bea-e214-480f-8ec5-944c40d400d5 req-b7ee8766-c734-4b91-9bed-d7ec9950a2aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "533174dc-5071-487b-9a2c-74cd7786af8a", "name": "network-vif-unplugged", "status": "completed", "tag": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30"}, {"server_uuid": "533174dc-5071-487b-9a2c-74cd7786af8a", "name": "network-vif-plugged", "status": "completed", "tag": "d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:46:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-88bb8bea-e214-480f-8ec5-944c40d400d5 req-b7ee8766-c734-4b91-9bed-d7ec9950a2aa service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:46:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-88bb8bea-e214-480f-8ec5-944c40d400d5 req-b7ee8766-c734-4b91-9bed-d7ec9950a2aa service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:46:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-88bb8bea-e214-480f-8ec5-944c40d400d5 req-b7ee8766-c734-4b91-9bed-d7ec9950a2aa service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:46:52 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-88bb8bea-e214-480f-8ec5-944c40d400d5 req-b7ee8766-c734-4b91-9bed-d7ec9950a2aa service nova] Creating event network-vif-unplugged:d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 for instance 533174dc-5071-487b-9a2c-74cd7786af8a on user Apr 12 00:46:52 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-88bb8bea-e214-480f-8ec5-944c40d400d5 req-b7ee8766-c734-4b91-9bed-d7ec9950a2aa service nova] Creating event network-vif-plugged:d983e69a-5d6a-40c9-b4b7-27c6cfa9ea30 for instance 533174dc-5071-487b-9a2c-74cd7786af8a on user Apr 12 00:46:52 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-88bb8bea-e214-480f-8ec5-944c40d400d5 req-b7ee8766-c734-4b91-9bed-d7ec9950a2aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030174 Apr 12 00:46:52 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 264/799] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:46:52 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:47:01 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "00c5aeee-0f41-4c27-99f4-e43510084de0"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:47:01 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:47:01 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:47:01 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=8 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:47:01 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:01 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:01 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:01 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:01 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:01 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:01 user devstack@n-api.service[72496]: DEBUG nova.objects.instance [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lazy-loading 'flavor' on Instance uuid b0c7ca20-c237-43b0-9a75-2a21392c7fd0 {{(pid=72496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:47:01 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-c05a0d72-e2ee-4cf9-b1ea-d7909277c5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b0c7ca20-c237-43b0-9a75-2a21392c7fd0/action" status: 200 len: 29 microversion: 2.87 time: 0.402691 Apr 12 00:47:01 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 269/800] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 00:47:01 2023] POST /compute/v2.1/servers/b0c7ca20-c237-43b0-9a75-2a21392c7fd0/action => generated 29 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:47:01 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-d43c5600-9c82-46ab-a07e-f66cf1afa731 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:47:01 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-d43c5600-9c82-46ab-a07e-f66cf1afa731 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:47:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d43c5600-9c82-46ab-a07e-f66cf1afa731 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d43c5600-9c82-46ab-a07e-f66cf1afa731 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d43c5600-9c82-46ab-a07e-f66cf1afa731 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d43c5600-9c82-46ab-a07e-f66cf1afa731 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d43c5600-9c82-46ab-a07e-f66cf1afa731 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-d43c5600-9c82-46ab-a07e-f66cf1afa731 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:01 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-d43c5600-9c82-46ab-a07e-f66cf1afa731 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:47:01 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-d43c5600-9c82-46ab-a07e-f66cf1afa731 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:47:01 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-d43c5600-9c82-46ab-a07e-f66cf1afa731 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:47:01 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-d43c5600-9c82-46ab-a07e-f66cf1afa731 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0c7ca20-c237-43b0-9a75-2a21392c7fd0" status: 200 len: 1775 microversion: 2.87 time: 0.166245 Apr 12 00:47:01 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 268/801] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:47:01 2023] GET /compute/v2.1/servers/b0c7ca20-c237-43b0-9a75-2a21392c7fd0 => generated 1775 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:47:02 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-cc6ab1e7-be6d-493a-99f7-67822bb04946 req-c43df188-6511-4402-9f1f-3e29987f0f77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c7ca20-c237-43b0-9a75-2a21392c7fd0", "name": "network-vif-unplugged", "status": "completed", "tag": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:47:02 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-cc6ab1e7-be6d-493a-99f7-67822bb04946 req-c43df188-6511-4402-9f1f-3e29987f0f77 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:02 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-cc6ab1e7-be6d-493a-99f7-67822bb04946 req-c43df188-6511-4402-9f1f-3e29987f0f77 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:02 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-cc6ab1e7-be6d-493a-99f7-67822bb04946 req-c43df188-6511-4402-9f1f-3e29987f0f77 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:02 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-cc6ab1e7-be6d-493a-99f7-67822bb04946 req-c43df188-6511-4402-9f1f-3e29987f0f77 service nova] Creating event network-vif-unplugged:2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 on user Apr 12 00:47:02 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-cc6ab1e7-be6d-493a-99f7-67822bb04946 req-c43df188-6511-4402-9f1f-3e29987f0f77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034389 Apr 12 00:47:02 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 265/802] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:47:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:47:04 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-01dd55eb-fabe-4283-8148-a8b9f91774d2 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:47:04 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-01dd55eb-fabe-4283-8148-a8b9f91774d2 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:47:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-01dd55eb-fabe-4283-8148-a8b9f91774d2 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-01dd55eb-fabe-4283-8148-a8b9f91774d2 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-01dd55eb-fabe-4283-8148-a8b9f91774d2 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-01dd55eb-fabe-4283-8148-a8b9f91774d2 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-01dd55eb-fabe-4283-8148-a8b9f91774d2 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-01dd55eb-fabe-4283-8148-a8b9f91774d2 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:04 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-01dd55eb-fabe-4283-8148-a8b9f91774d2 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:47:04 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-01dd55eb-fabe-4283-8148-a8b9f91774d2 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749" status: 200 len: 1428 microversion: 2.1 time: 0.153251 Apr 12 00:47:04 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 270/803] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:47:04 2023] GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749 => generated 1428 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:47:04 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-a227408f-43c9-4431-b03f-f7d20176ac57 req-9054883f-c256-49ee-a3ea-621822cf48f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c7ca20-c237-43b0-9a75-2a21392c7fd0", "name": "network-vif-plugged", "status": "completed", "tag": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:47:04 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-a227408f-43c9-4431-b03f-f7d20176ac57 req-9054883f-c256-49ee-a3ea-621822cf48f0 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:04 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-a227408f-43c9-4431-b03f-f7d20176ac57 req-9054883f-c256-49ee-a3ea-621822cf48f0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:04 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-a227408f-43c9-4431-b03f-f7d20176ac57 req-9054883f-c256-49ee-a3ea-621822cf48f0 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:04 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-a227408f-43c9-4431-b03f-f7d20176ac57 req-9054883f-c256-49ee-a3ea-621822cf48f0 service nova] Creating event network-vif-plugged:2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 on user Apr 12 00:47:04 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-a227408f-43c9-4431-b03f-f7d20176ac57 req-9054883f-c256-49ee-a3ea-621822cf48f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029478 Apr 12 00:47:04 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 269/804] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:47:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:47:06 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-8ce437ae-25ee-4bec-aae7-da55b039d7bd req-ae136f62-cccd-4eff-8321-48b8bb58d56a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c7ca20-c237-43b0-9a75-2a21392c7fd0", "name": "network-vif-plugged", "status": "completed", "tag": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:47:06 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8ce437ae-25ee-4bec-aae7-da55b039d7bd req-ae136f62-cccd-4eff-8321-48b8bb58d56a service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:06 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8ce437ae-25ee-4bec-aae7-da55b039d7bd req-ae136f62-cccd-4eff-8321-48b8bb58d56a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:06 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8ce437ae-25ee-4bec-aae7-da55b039d7bd req-ae136f62-cccd-4eff-8321-48b8bb58d56a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:06 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-8ce437ae-25ee-4bec-aae7-da55b039d7bd req-ae136f62-cccd-4eff-8321-48b8bb58d56a service nova] Creating event network-vif-plugged:2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 on user Apr 12 00:47:06 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-8ce437ae-25ee-4bec-aae7-da55b039d7bd req-ae136f62-cccd-4eff-8321-48b8bb58d56a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029428 Apr 12 00:47:06 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 266/805] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:47:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:47:08 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-18be60b1-c530-4d66-a6dd-a8672e5707eb req-42ab5071-41b0-4d03-8743-657ab990187c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c7ca20-c237-43b0-9a75-2a21392c7fd0", "name": "network-vif-plugged", "status": "completed", "tag": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:47:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-18be60b1-c530-4d66-a6dd-a8672e5707eb req-42ab5071-41b0-4d03-8743-657ab990187c service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-18be60b1-c530-4d66-a6dd-a8672e5707eb req-42ab5071-41b0-4d03-8743-657ab990187c service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-18be60b1-c530-4d66-a6dd-a8672e5707eb req-42ab5071-41b0-4d03-8743-657ab990187c service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:08 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-18be60b1-c530-4d66-a6dd-a8672e5707eb req-42ab5071-41b0-4d03-8743-657ab990187c service nova] Creating event network-vif-plugged:2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 on user Apr 12 00:47:08 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-18be60b1-c530-4d66-a6dd-a8672e5707eb req-42ab5071-41b0-4d03-8743-657ab990187c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070301 Apr 12 00:47:08 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 271/806] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:47:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:47:18 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=10 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:47:18 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=12 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:47:18 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-8915864a-a942-4e86-91e3-5be169dc6098 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:47:18 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-8915864a-a942-4e86-91e3-5be169dc6098 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:47:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8915864a-a942-4e86-91e3-5be169dc6098 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8915864a-a942-4e86-91e3-5be169dc6098 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8915864a-a942-4e86-91e3-5be169dc6098 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8915864a-a942-4e86-91e3-5be169dc6098 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8915864a-a942-4e86-91e3-5be169dc6098 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8915864a-a942-4e86-91e3-5be169dc6098 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:18 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-8915864a-a942-4e86-91e3-5be169dc6098 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842535891eb4a9880f7e8859dd0de3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66fda80cb83402392e155c76ee78e1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:47:18 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-8915864a-a942-4e86-91e3-5be169dc6098 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90" status: 200 len: 1534 microversion: 2.1 time: 0.181465 Apr 12 00:47:18 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 270/807] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:47:18 2023] GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90 => generated 1534 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:47:18 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:47:18 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:47:18 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-9f5c4270-802b-4a85-a836-f68f9e818e5e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:47:18 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-9f5c4270-802b-4a85-a836-f68f9e818e5e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:47:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9f5c4270-802b-4a85-a836-f68f9e818e5e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9f5c4270-802b-4a85-a836-f68f9e818e5e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9f5c4270-802b-4a85-a836-f68f9e818e5e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9f5c4270-802b-4a85-a836-f68f9e818e5e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9f5c4270-802b-4a85-a836-f68f9e818e5e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-9f5c4270-802b-4a85-a836-f68f9e818e5e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:18 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-9f5c4270-802b-4a85-a836-f68f9e818e5e tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050344 Apr 12 00:47:18 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 267/808] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:47:18 2023] GET /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:47:19 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:47:19 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:47:19 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:47:19 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:47:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:19 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Going to try to terminate instance {{(pid=72496) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:47:19 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-28a4d891-55ac-45b4-b8d4-5e184e08ea6f tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7" status: 204 len: 0 microversion: 2.1 time: 0.134256 Apr 12 00:47:19 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 272/809] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:47:19 2023] DELETE /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:47:19 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-c9801ffc-1480-4458-9bb6-9402140a0c1c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:47:19 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-c9801ffc-1480-4458-9bb6-9402140a0c1c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:47:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c9801ffc-1480-4458-9bb6-9402140a0c1c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c9801ffc-1480-4458-9bb6-9402140a0c1c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c9801ffc-1480-4458-9bb6-9402140a0c1c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c9801ffc-1480-4458-9bb6-9402140a0c1c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c9801ffc-1480-4458-9bb6-9402140a0c1c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c9801ffc-1480-4458-9bb6-9402140a0c1c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:19 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-c9801ffc-1480-4458-9bb6-9402140a0c1c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd373f582479c441e8ce9849ca694a186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56f3c567dc84773a33d596920df727a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:47:19 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-c9801ffc-1480-4458-9bb6-9402140a0c1c tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7" status: 200 len: 1665 microversion: 2.1 time: 0.184370 Apr 12 00:47:19 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 271/810] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:47:19 2023] GET /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7 => generated 1665 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:47:19 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-4b8b68bb-60bc-4de1-85c1-a7518ffa8283 req-b191c207-bd70-4868-b7d7-19687a2dea5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a346a131-2502-457a-acb8-8f903a7b87a7", "name": "network-vif-unplugged", "status": "completed", "tag": "9457e7d7-925c-4488-bb2d-c3019a663c42"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:47:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-4b8b68bb-60bc-4de1-85c1-a7518ffa8283 req-b191c207-bd70-4868-b7d7-19687a2dea5e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-4b8b68bb-60bc-4de1-85c1-a7518ffa8283 req-b191c207-bd70-4868-b7d7-19687a2dea5e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-4b8b68bb-60bc-4de1-85c1-a7518ffa8283 req-b191c207-bd70-4868-b7d7-19687a2dea5e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:19 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-4b8b68bb-60bc-4de1-85c1-a7518ffa8283 req-b191c207-bd70-4868-b7d7-19687a2dea5e service nova] Creating event network-vif-unplugged:9457e7d7-925c-4488-bb2d-c3019a663c42 for instance a346a131-2502-457a-acb8-8f903a7b87a7 on user Apr 12 00:47:19 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-4b8b68bb-60bc-4de1-85c1-a7518ffa8283 req-b191c207-bd70-4868-b7d7-19687a2dea5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036848 Apr 12 00:47:19 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 268/811] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:47:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:47:21 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-130bf9bb-cbc7-414d-982f-ec748af423a0 req-fd2de83d-a247-425e-ba39-cdf67f827b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a346a131-2502-457a-acb8-8f903a7b87a7", "name": "network-vif-plugged", "status": "completed", "tag": "9457e7d7-925c-4488-bb2d-c3019a663c42"}, {"server_uuid": "a346a131-2502-457a-acb8-8f903a7b87a7", "name": "network-vif-deleted", "tag": "9457e7d7-925c-4488-bb2d-c3019a663c42"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:47:21 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-130bf9bb-cbc7-414d-982f-ec748af423a0 req-fd2de83d-a247-425e-ba39-cdf67f827b0d service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:21 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-130bf9bb-cbc7-414d-982f-ec748af423a0 req-fd2de83d-a247-425e-ba39-cdf67f827b0d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:21 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-130bf9bb-cbc7-414d-982f-ec748af423a0 req-fd2de83d-a247-425e-ba39-cdf67f827b0d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:21 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-130bf9bb-cbc7-414d-982f-ec748af423a0 req-fd2de83d-a247-425e-ba39-cdf67f827b0d service nova] Creating event network-vif-plugged:9457e7d7-925c-4488-bb2d-c3019a663c42 for instance a346a131-2502-457a-acb8-8f903a7b87a7 on user Apr 12 00:47:21 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-130bf9bb-cbc7-414d-982f-ec748af423a0 req-fd2de83d-a247-425e-ba39-cdf67f827b0d service nova] Creating event network-vif-deleted:9457e7d7-925c-4488-bb2d-c3019a663c42 for instance a346a131-2502-457a-acb8-8f903a7b87a7 on user Apr 12 00:47:21 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-130bf9bb-cbc7-414d-982f-ec748af423a0 req-fd2de83d-a247-425e-ba39-cdf67f827b0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030761 Apr 12 00:47:21 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 273/812] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:47:21 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:47:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-17532b2c-9804-4de8-9588-379684c13a3a tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:47:27 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-17532b2c-9804-4de8-9588-379684c13a3a tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] [instance: 8d895d64-319f-4c67-8c20-ef0d0437a1f0] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:47:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-17532b2c-9804-4de8-9588-379684c13a3a tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-17532b2c-9804-4de8-9588-379684c13a3a tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-17532b2c-9804-4de8-9588-379684c13a3a tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-17532b2c-9804-4de8-9588-379684c13a3a tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-17532b2c-9804-4de8-9588-379684c13a3a tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-17532b2c-9804-4de8-9588-379684c13a3a tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:27 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-17532b2c-9804-4de8-9588-379684c13a3a tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] HTTP exception thrown: Instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 could not be found. Apr 12 00:47:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-17532b2c-9804-4de8-9588-379684c13a3a tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Request method failure captured: Apr 12 00:47:27 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0 HTTP/1.1 Apr 12 00:47:27 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:47:27 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:47:27 user devstack@n-api.service[72494]: Connection: close Apr 12 00:47:27 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:47:27 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:47:27 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:47:27 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:47:27 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:47:27 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNft5KIxwEgdwTqD-CgWzQHRf_FoqYilC4_z8sLEvoXo1R3M7HNE1MMy-1-GlWM0X8BruNgg2BCXLv_-0_S4kRyGh3lOQ6Sb9IfuhvN2rkuUyf5ySkxhKP32iNzWpbdPq8mfldEe_U0xhj5wtI02KiYIEO-zb6pTaOupaX4Sx0JOImss Apr 12 00:47:27 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:47:27 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:47:27 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:47:27 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:47:27 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:47:27 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:47:27 user devstack@n-api.service[72494]: X-Project-Id: fcf1fea74ef143e6b394e41e7c4ed495 Apr 12 00:47:27 user devstack@n-api.service[72494]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1300870234 Apr 12 00:47:27 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:47:27 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:47:27 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fcf1fea74ef143e6b394e41e7c4ed495"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fcf1fea74ef143e6b394e41e7c4ed495"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fcf1fea74ef143e6b394e41e7c4ed495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:47:27 user devstack@n-api.service[72494]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1300870234 Apr 12 00:47:27 user devstack@n-api.service[72494]: X-Tenant-Id: fcf1fea74ef143e6b394e41e7c4ed495 Apr 12 00:47:27 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1300870234 Apr 12 00:47:27 user devstack@n-api.service[72494]: X-User: tempest-ServerRescueNegativeTestJSON-1300870234-project-member Apr 12 00:47:27 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:47:27 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:47:27 user devstack@n-api.service[72494]: X-User-Id: 6b9421443b2f421298a934122c6a8b8c Apr 12 00:47:27 user devstack@n-api.service[72494]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1300870234-project-member Apr 12 00:47:27 user devstack@n-api.service[72494]: method: > Apr 12 00:47:27 user devstack@n-api.service[72494]: exception: Instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 could not be found. Apr 12 00:47:27 user devstack@n-api.service[72494]: action_args: {'id': '8d895d64-319f-4c67-8c20-ef0d0437a1f0'} Apr 12 00:47:27 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 could not be found. Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 could not be found. Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 could not be found. Apr 12 00:47:27 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:47:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-17532b2c-9804-4de8-9588-379684c13a3a tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] Returning 404 to user: Instance 8d895d64-319f-4c67-8c20-ef0d0437a1f0 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:47:27 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-17532b2c-9804-4de8-9588-379684c13a3a tempest-ServerRescueNegativeTestJSON-1300870234 tempest-ServerRescueNegativeTestJSON-1300870234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0" status: 404 len: 111 microversion: 2.1 time: 0.027867 Apr 12 00:47:27 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 272/813] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:47:27 2023] GET /compute/v2.1/servers/8d895d64-319f-4c67-8c20-ef0d0437a1f0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:47:37 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:47:37 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=8 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:47:37 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-a7ef06eb-e7ec-4363-ac8a-fee392e1a57e tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Action: 'create', calling method: .version_select at 0x7f7cd454ba30>, body: {"keypair": {"name": "tempest-keypair-1276421029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMokxkK7zF60NPptUZtqbNVO4ee0RHPLQ2WdZtjVQCu24iwsegquteqO8OdbQ9GAUZ1SkIIyk/ht01FuuBU5gCdEaHsQ1JWfdkBxOdNOEqXUd7E1coKER+ZBFRQ3Q9eu5A=="}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:47:37 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-a7ef06eb-e7ec-4363-ac8a-fee392e1a57e tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Getting quotas for project c26d891933d647b7b27c75915fb726f3. Resources: {'key_pairs'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:47:37 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-a7ef06eb-e7ec-4363-ac8a-fee392e1a57e tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Getting quotas for user 418881a7e56e4c19bbf900ef71029ce0 and project c26d891933d647b7b27c75915fb726f3. Resources: {'key_pairs'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:47:37 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-a7ef06eb-e7ec-4363-ac8a-fee392e1a57e tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.152799 Apr 12 00:47:37 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 269/814] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 00:47:37 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 154 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 00:47:38 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:47:38 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:47:38 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2121286429", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "7ecd3c10-773d-4651-a82d-42b4aaad386f"}], "security_groups": [{"name": "tempest-securitygroup--883042570"}], "key_name": "tempest-keypair-1276421029", "user_data": "}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:47:38 user devstack@n-api.service[72496]: DEBUG nova.network.neutron [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] validate_networks() for [('7ecd3c10-773d-4651-a82d-42b4aaad386f', None, None, None, None, None)] {{(pid=72496) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:47:39 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Flavor limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:47:39 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Image limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:47:39 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Flavor pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:47:39 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Image pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:47:39 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:47:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:39 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Getting quotas for project c26d891933d647b7b27c75915fb726f3. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:47:39 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Getting quotas for user 418881a7e56e4c19bbf900ef71029ce0 and project c26d891933d647b7b27c75915fb726f3. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:47:39 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Going to run 1 instances... {{(pid=72496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:47:39 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:47:39 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-9910103d-2d16-42cb-922a-36371a5ed91f tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.579331 Apr 12 00:47:39 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 274/815] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 00:47:38 2023] POST /compute/v2.1/servers => generated 399 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 00:47:39 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-c06c7256-dcbd-471c-b5aa-510ae261faba tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:47:39 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-c06c7256-dcbd-471c-b5aa-510ae261faba tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:47:39 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=6 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:47:39 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=14 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:47:39 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-c06c7256-dcbd-471c-b5aa-510ae261faba tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:47:39 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-c06c7256-dcbd-471c-b5aa-510ae261faba tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:47:39 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-c06c7256-dcbd-471c-b5aa-510ae261faba tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:47:39 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-c06c7256-dcbd-471c-b5aa-510ae261faba tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580" status: 200 len: 1276 microversion: 2.20 time: 0.072367 Apr 12 00:47:39 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 273/816] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:47:39 2023] GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580 => generated 1276 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:47:40 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-c8cbdf6c-212f-4e59-90fc-00aa0e89dffd tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:47:40 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-c8cbdf6c-212f-4e59-90fc-00aa0e89dffd tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: 533174dc-5071-487b-9a2c-74cd7786af8a] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:47:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c8cbdf6c-212f-4e59-90fc-00aa0e89dffd tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c8cbdf6c-212f-4e59-90fc-00aa0e89dffd tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c8cbdf6c-212f-4e59-90fc-00aa0e89dffd tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c8cbdf6c-212f-4e59-90fc-00aa0e89dffd tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:41 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c8cbdf6c-212f-4e59-90fc-00aa0e89dffd tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:41 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c8cbdf6c-212f-4e59-90fc-00aa0e89dffd tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:41 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-c8cbdf6c-212f-4e59-90fc-00aa0e89dffd tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] HTTP exception thrown: Instance 533174dc-5071-487b-9a2c-74cd7786af8a could not be found. Apr 12 00:47:41 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-c8cbdf6c-212f-4e59-90fc-00aa0e89dffd tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Request method failure captured: Apr 12 00:47:41 user devstack@n-api.service[72495]: request: GET /compute/v2.1/servers/533174dc-5071-487b-9a2c-74cd7786af8a HTTP/1.1 Apr 12 00:47:41 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:47:41 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:47:41 user devstack@n-api.service[72495]: Connection: close Apr 12 00:47:41 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 00:47:41 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:47:41 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:47:41 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:47:41 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:47:41 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNfut1jPVwgpnHF2p4IDb8mw8QCnmrhPi1bglXERi9o-oc8KfA86Nj8qbMXqGPJ-Qu-hg1buox-hKkUkiuJLGP2TjR-hKqepkY3sMZyNoxK3mS9Lgsu4E_4fnuzEqTUjrpCZSmbPFt9R2omKh-uhIkWfp0X1fr8C_wHlflXHVBJsAvYQ Apr 12 00:47:41 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:47:41 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:47:41 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:47:41 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:47:41 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:47:41 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:47:41 user devstack@n-api.service[72495]: X-Project-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:47:41 user devstack@n-api.service[72495]: X-Project-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:47:41 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:47:41 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:47:41 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:47:41 user devstack@n-api.service[72495]: X-Tenant: tempest-TestVolumeBootPattern-726466832 Apr 12 00:47:41 user devstack@n-api.service[72495]: X-Tenant-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:47:41 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:47:41 user devstack@n-api.service[72495]: X-User: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:47:41 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:47:41 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:47:41 user devstack@n-api.service[72495]: X-User-Id: c479f6ae2f0d40908be9b07717ca3509 Apr 12 00:47:41 user devstack@n-api.service[72495]: X-User-Name: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:47:41 user devstack@n-api.service[72495]: method: > Apr 12 00:47:41 user devstack@n-api.service[72495]: exception: Instance 533174dc-5071-487b-9a2c-74cd7786af8a could not be found. Apr 12 00:47:41 user devstack@n-api.service[72495]: action_args: {'id': '533174dc-5071-487b-9a2c-74cd7786af8a'} Apr 12 00:47:41 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 533174dc-5071-487b-9a2c-74cd7786af8a could not be found. Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 533174dc-5071-487b-9a2c-74cd7786af8a could not be found. Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 533174dc-5071-487b-9a2c-74cd7786af8a could not be found. Apr 12 00:47:41 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:47:41 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-c8cbdf6c-212f-4e59-90fc-00aa0e89dffd tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Returning 404 to user: Instance 533174dc-5071-487b-9a2c-74cd7786af8a could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:47:41 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-c8cbdf6c-212f-4e59-90fc-00aa0e89dffd tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/533174dc-5071-487b-9a2c-74cd7786af8a" status: 404 len: 111 microversion: 2.1 time: 0.037338 Apr 12 00:47:41 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 270/817] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:47:40 2023] GET /compute/v2.1/servers/533174dc-5071-487b-9a2c-74cd7786af8a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:47:41 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-6e388d2b-0e61-40a8-a918-b9b7e7ed19c7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:47:41 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-6e388d2b-0e61-40a8-a918-b9b7e7ed19c7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:47:41 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6e388d2b-0e61-40a8-a918-b9b7e7ed19c7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:41 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6e388d2b-0e61-40a8-a918-b9b7e7ed19c7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:41 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6e388d2b-0e61-40a8-a918-b9b7e7ed19c7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:41 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6e388d2b-0e61-40a8-a918-b9b7e7ed19c7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:41 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6e388d2b-0e61-40a8-a918-b9b7e7ed19c7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:41 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6e388d2b-0e61-40a8-a918-b9b7e7ed19c7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:41 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-6e388d2b-0e61-40a8-a918-b9b7e7ed19c7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] HTTP exception thrown: Instance ecfc9ba1-d560-410d-af55-8d5e578aa00d could not be found. Apr 12 00:47:41 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-6e388d2b-0e61-40a8-a918-b9b7e7ed19c7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Request method failure captured: Apr 12 00:47:41 user devstack@n-api.service[72496]: request: DELETE /compute/v2.1/servers/ecfc9ba1-d560-410d-af55-8d5e578aa00d HTTP/1.1 Apr 12 00:47:41 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:47:41 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:47:41 user devstack@n-api.service[72496]: Connection: close Apr 12 00:47:41 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:47:41 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:47:41 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:47:41 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:47:41 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:47:41 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNfut1jPVwgpnHF2p4IDb8mw8QCnmrhPi1bglXERi9o-oc8KfA86Nj8qbMXqGPJ-Qu-hg1buox-hKkUkiuJLGP2TjR-hKqepkY3sMZyNoxK3mS9Lgsu4E_4fnuzEqTUjrpCZSmbPFt9R2omKh-uhIkWfp0X1fr8C_wHlflXHVBJsAvYQ Apr 12 00:47:41 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:47:41 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:47:41 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:47:41 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:47:41 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:47:41 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:47:41 user devstack@n-api.service[72496]: X-Project-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:47:41 user devstack@n-api.service[72496]: X-Project-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:47:41 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:47:41 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:47:41 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:47:41 user devstack@n-api.service[72496]: X-Tenant: tempest-TestVolumeBootPattern-726466832 Apr 12 00:47:41 user devstack@n-api.service[72496]: X-Tenant-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:47:41 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:47:41 user devstack@n-api.service[72496]: X-User: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:47:41 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:47:41 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:47:41 user devstack@n-api.service[72496]: X-User-Id: c479f6ae2f0d40908be9b07717ca3509 Apr 12 00:47:41 user devstack@n-api.service[72496]: X-User-Name: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:47:41 user devstack@n-api.service[72496]: method: > Apr 12 00:47:41 user devstack@n-api.service[72496]: exception: Instance ecfc9ba1-d560-410d-af55-8d5e578aa00d could not be found. Apr 12 00:47:41 user devstack@n-api.service[72496]: action_args: {'id': 'ecfc9ba1-d560-410d-af55-8d5e578aa00d'} Apr 12 00:47:41 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecfc9ba1-d560-410d-af55-8d5e578aa00d could not be found. Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecfc9ba1-d560-410d-af55-8d5e578aa00d could not be found. Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecfc9ba1-d560-410d-af55-8d5e578aa00d could not be found. Apr 12 00:47:41 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:47:41 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-6e388d2b-0e61-40a8-a918-b9b7e7ed19c7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Returning 404 to user: Instance ecfc9ba1-d560-410d-af55-8d5e578aa00d could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:47:41 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-6e388d2b-0e61-40a8-a918-b9b7e7ed19c7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ecfc9ba1-d560-410d-af55-8d5e578aa00d" status: 404 len: 111 microversion: 2.1 time: 0.028884 Apr 12 00:47:41 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 275/818] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:47:41 2023] DELETE /compute/v2.1/servers/ecfc9ba1-d560-410d-af55-8d5e578aa00d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:47:41 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-c676357a-8173-4a19-8639-a7e31361e8e7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:47:41 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-c676357a-8173-4a19-8639-a7e31361e8e7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] [instance: ecfc9ba1-d560-410d-af55-8d5e578aa00d] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:47:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c676357a-8173-4a19-8639-a7e31361e8e7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c676357a-8173-4a19-8639-a7e31361e8e7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c676357a-8173-4a19-8639-a7e31361e8e7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c676357a-8173-4a19-8639-a7e31361e8e7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c676357a-8173-4a19-8639-a7e31361e8e7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c676357a-8173-4a19-8639-a7e31361e8e7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:41 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-c676357a-8173-4a19-8639-a7e31361e8e7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] HTTP exception thrown: Instance ecfc9ba1-d560-410d-af55-8d5e578aa00d could not be found. Apr 12 00:47:41 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-c676357a-8173-4a19-8639-a7e31361e8e7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Request method failure captured: Apr 12 00:47:41 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/ecfc9ba1-d560-410d-af55-8d5e578aa00d HTTP/1.1 Apr 12 00:47:41 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:47:41 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:47:41 user devstack@n-api.service[72494]: Connection: close Apr 12 00:47:41 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:47:41 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:47:41 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:47:41 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:47:41 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:47:41 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNfut1jPVwgpnHF2p4IDb8mw8QCnmrhPi1bglXERi9o-oc8KfA86Nj8qbMXqGPJ-Qu-hg1buox-hKkUkiuJLGP2TjR-hKqepkY3sMZyNoxK3mS9Lgsu4E_4fnuzEqTUjrpCZSmbPFt9R2omKh-uhIkWfp0X1fr8C_wHlflXHVBJsAvYQ Apr 12 00:47:41 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:47:41 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:47:41 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:47:41 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:47:41 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:47:41 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:47:41 user devstack@n-api.service[72494]: X-Project-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:47:41 user devstack@n-api.service[72494]: X-Project-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:47:41 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:47:41 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:47:41 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e38a98bf1d964ee6bd2d0d05e97a283a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:47:41 user devstack@n-api.service[72494]: X-Tenant: tempest-TestVolumeBootPattern-726466832 Apr 12 00:47:41 user devstack@n-api.service[72494]: X-Tenant-Id: e38a98bf1d964ee6bd2d0d05e97a283a Apr 12 00:47:41 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-TestVolumeBootPattern-726466832 Apr 12 00:47:41 user devstack@n-api.service[72494]: X-User: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:47:41 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:47:41 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:47:41 user devstack@n-api.service[72494]: X-User-Id: c479f6ae2f0d40908be9b07717ca3509 Apr 12 00:47:41 user devstack@n-api.service[72494]: X-User-Name: tempest-TestVolumeBootPattern-726466832-project-member Apr 12 00:47:41 user devstack@n-api.service[72494]: method: > Apr 12 00:47:41 user devstack@n-api.service[72494]: exception: Instance ecfc9ba1-d560-410d-af55-8d5e578aa00d could not be found. Apr 12 00:47:41 user devstack@n-api.service[72494]: action_args: {'id': 'ecfc9ba1-d560-410d-af55-8d5e578aa00d'} Apr 12 00:47:41 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecfc9ba1-d560-410d-af55-8d5e578aa00d could not be found. Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecfc9ba1-d560-410d-af55-8d5e578aa00d could not be found. Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecfc9ba1-d560-410d-af55-8d5e578aa00d could not be found. Apr 12 00:47:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:47:41 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-c676357a-8173-4a19-8639-a7e31361e8e7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Returning 404 to user: Instance ecfc9ba1-d560-410d-af55-8d5e578aa00d could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:47:41 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-c676357a-8173-4a19-8639-a7e31361e8e7 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ecfc9ba1-d560-410d-af55-8d5e578aa00d" status: 404 len: 111 microversion: 2.1 time: 0.029050 Apr 12 00:47:41 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 274/819] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:47:41 2023] GET /compute/v2.1/servers/ecfc9ba1-d560-410d-af55-8d5e578aa00d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:47:42 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-e04fbaf7-844e-4601-bde1-b7ea55dfdb28 req-06e33848-0a72-46d8-80bb-c62ca10e6fba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d163ed-7900-486c-8b96-101af5547580", "tag": "f10369c7-25e6-4570-86a1-5e9ec3e941be"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:47:42 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-e04fbaf7-844e-4601-bde1-b7ea55dfdb28 req-06e33848-0a72-46d8-80bb-c62ca10e6fba service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:42 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-e04fbaf7-844e-4601-bde1-b7ea55dfdb28 req-06e33848-0a72-46d8-80bb-c62ca10e6fba service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:42 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-e04fbaf7-844e-4601-bde1-b7ea55dfdb28 req-06e33848-0a72-46d8-80bb-c62ca10e6fba service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:42 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-e04fbaf7-844e-4601-bde1-b7ea55dfdb28 req-06e33848-0a72-46d8-80bb-c62ca10e6fba service nova] Creating event network-changed:f10369c7-25e6-4570-86a1-5e9ec3e941be for instance a4d163ed-7900-486c-8b96-101af5547580 on user Apr 12 00:47:42 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-e04fbaf7-844e-4601-bde1-b7ea55dfdb28 req-06e33848-0a72-46d8-80bb-c62ca10e6fba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030160 Apr 12 00:47:42 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 271/820] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:47:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:47:43 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-66a56d85-4373-4831-8dac-4737708d2084 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] Calling method '.version_select at 0x7f7cd4476950>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:47:43 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-66a56d85-4373-4831-8dac-4737708d2084 tempest-TestVolumeBootPattern-726466832 tempest-TestVolumeBootPattern-726466832-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1592613584" status: 202 len: 0 microversion: 2.1 time: 0.036499 Apr 12 00:47:43 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 276/821] 10.0.0.210 () {62 vars in 1340 bytes} [Wed Apr 12 00:47:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1592613584 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:47:44 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-a6270202-8529-40a9-ad49-bb29c6655256 req-2019faf1-9ed8-49b5-8621-2dc0692eaa2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d163ed-7900-486c-8b96-101af5547580", "name": "network-vif-plugged", "status": "completed", "tag": "f10369c7-25e6-4570-86a1-5e9ec3e941be"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:47:44 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-a6270202-8529-40a9-ad49-bb29c6655256 req-2019faf1-9ed8-49b5-8621-2dc0692eaa2d service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:44 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-a6270202-8529-40a9-ad49-bb29c6655256 req-2019faf1-9ed8-49b5-8621-2dc0692eaa2d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:44 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-a6270202-8529-40a9-ad49-bb29c6655256 req-2019faf1-9ed8-49b5-8621-2dc0692eaa2d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:44 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-a6270202-8529-40a9-ad49-bb29c6655256 req-2019faf1-9ed8-49b5-8621-2dc0692eaa2d service nova] Creating event network-vif-plugged:f10369c7-25e6-4570-86a1-5e9ec3e941be for instance a4d163ed-7900-486c-8b96-101af5547580 on user Apr 12 00:47:44 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-a6270202-8529-40a9-ad49-bb29c6655256 req-2019faf1-9ed8-49b5-8621-2dc0692eaa2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030005 Apr 12 00:47:44 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 275/822] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:47:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:47:46 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-d2c59a66-0c16-4e6e-897d-9ac9f8371bda req-3ab93899-7d9c-4e84-a6c7-f550d75ec862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d163ed-7900-486c-8b96-101af5547580", "name": "network-vif-plugged", "status": "completed", "tag": "f10369c7-25e6-4570-86a1-5e9ec3e941be"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:47:46 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d2c59a66-0c16-4e6e-897d-9ac9f8371bda req-3ab93899-7d9c-4e84-a6c7-f550d75ec862 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:46 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d2c59a66-0c16-4e6e-897d-9ac9f8371bda req-3ab93899-7d9c-4e84-a6c7-f550d75ec862 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:46 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d2c59a66-0c16-4e6e-897d-9ac9f8371bda req-3ab93899-7d9c-4e84-a6c7-f550d75ec862 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:46 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-d2c59a66-0c16-4e6e-897d-9ac9f8371bda req-3ab93899-7d9c-4e84-a6c7-f550d75ec862 service nova] Creating event network-vif-plugged:f10369c7-25e6-4570-86a1-5e9ec3e941be for instance a4d163ed-7900-486c-8b96-101af5547580 on user Apr 12 00:47:46 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-d2c59a66-0c16-4e6e-897d-9ac9f8371bda req-3ab93899-7d9c-4e84-a6c7-f550d75ec862 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089795 Apr 12 00:47:46 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 272/823] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:47:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:47:51 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:47:51 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:47:51 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-36f9c8c7-af31-468d-b7ec-1482f07ade10 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:47:51 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-36f9c8c7-af31-468d-b7ec-1482f07ade10 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:47:51 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:47:51 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-36f9c8c7-af31-468d-b7ec-1482f07ade10 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:51 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-36f9c8c7-af31-468d-b7ec-1482f07ade10 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:51 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-36f9c8c7-af31-468d-b7ec-1482f07ade10 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:51 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-36f9c8c7-af31-468d-b7ec-1482f07ade10 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:47:51 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-36f9c8c7-af31-468d-b7ec-1482f07ade10 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:47:51 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-36f9c8c7-af31-468d-b7ec-1482f07ade10 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:47:52 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-36f9c8c7-af31-468d-b7ec-1482f07ade10 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:47:52 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-36f9c8c7-af31-468d-b7ec-1482f07ade10 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:47:52 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-36f9c8c7-af31-468d-b7ec-1482f07ade10 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:47:52 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-36f9c8c7-af31-468d-b7ec-1482f07ade10 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0c7ca20-c237-43b0-9a75-2a21392c7fd0" status: 200 len: 1755 microversion: 2.87 time: 0.273047 Apr 12 00:47:52 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 277/824] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:47:51 2023] GET /compute/v2.1/servers/b0c7ca20-c237-43b0-9a75-2a21392c7fd0 => generated 1755 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:48:04 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:48:04 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=8 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:48:04 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=4 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:48:04 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-01b28573-5b99-41a8-bc93-496bfb89f9c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:04 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-01b28573-5b99-41a8-bc93-496bfb89f9c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:04 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-01b28573-5b99-41a8-bc93-496bfb89f9c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:04 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-01b28573-5b99-41a8-bc93-496bfb89f9c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:04 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-01b28573-5b99-41a8-bc93-496bfb89f9c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:04 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-01b28573-5b99-41a8-bc93-496bfb89f9c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:04 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-01b28573-5b99-41a8-bc93-496bfb89f9c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:04 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-01b28573-5b99-41a8-bc93-496bfb89f9c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:04 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-01b28573-5b99-41a8-bc93-496bfb89f9c6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.358525 Apr 12 00:48:04 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 276/825] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 00:48:04 2023] GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749/os-interface => generated 282 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:05 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-6650a6dd-427c-437f-86cd-478bd95c8cd2 req-63c914c3-2b2d-4439-b882-07dc061a4d91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84861eef-6d59-448b-b6b7-eb8dd8e47b30", "tag": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:48:05 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:48:05 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-6aaf815f-198d-42c4-8195-ca70a3b0e5e2 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:05 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-6aaf815f-198d-42c4-8195-ca70a3b0e5e2 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:05 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:48:05 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:48:05 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:48:05 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:48:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6aaf815f-198d-42c4-8195-ca70a3b0e5e2 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6aaf815f-198d-42c4-8195-ca70a3b0e5e2 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6aaf815f-198d-42c4-8195-ca70a3b0e5e2 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6aaf815f-198d-42c4-8195-ca70a3b0e5e2 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6aaf815f-198d-42c4-8195-ca70a3b0e5e2 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6aaf815f-198d-42c4-8195-ca70a3b0e5e2 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:05 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-6650a6dd-427c-437f-86cd-478bd95c8cd2 req-63c914c3-2b2d-4439-b882-07dc061a4d91 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:05 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-6650a6dd-427c-437f-86cd-478bd95c8cd2 req-63c914c3-2b2d-4439-b882-07dc061a4d91 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:05 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-6650a6dd-427c-437f-86cd-478bd95c8cd2 req-63c914c3-2b2d-4439-b882-07dc061a4d91 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:05 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-6650a6dd-427c-437f-86cd-478bd95c8cd2 req-63c914c3-2b2d-4439-b882-07dc061a4d91 service nova] Creating event network-changed:df061f79-7574-4b3c-9cf4-2b0e61c5efc1 for instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30 on user Apr 12 00:48:05 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-6650a6dd-427c-437f-86cd-478bd95c8cd2 req-63c914c3-2b2d-4439-b882-07dc061a4d91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083197 Apr 12 00:48:05 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 273/826] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:48:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:05 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-6aaf815f-198d-42c4-8195-ca70a3b0e5e2 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:48:05 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-6aaf815f-198d-42c4-8195-ca70a3b0e5e2 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749" status: 200 len: 1428 microversion: 2.1 time: 0.200799 Apr 12 00:48:05 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 278/827] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:48:05 2023] GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749 => generated 1428 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:48:05 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:48:05 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:06 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:48:06 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Old instance type m1.nano, new instance type m1.micro {{(pid=72494) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 12 00:48:06 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:06 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:06 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:06 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:06 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:06 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:06 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting quotas for project d8ba626fdf264b879099a89097845153. Resources: {'ram', 'cores'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:48:06 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Getting quotas for user d658147b4def4d12a16381d4c19357e3 and project d8ba626fdf264b879099a89097845153. Resources: {'ram', 'cores'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:48:06 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:48:06 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:48:06 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Flavor pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:48:06 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Image pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:48:06 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:48:06 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-4a383937-562d-4f4b-ac3e-c43ff4b646d7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749/action" status: 202 len: 0 microversion: 2.1 time: 0.338421 Apr 12 00:48:06 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 277/828] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 00:48:05 2023] POST /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:48:06 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-5c33d0cf-6189-4433-b709-35903ceecc49 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:06 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-5c33d0cf-6189-4433-b709-35903ceecc49 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:06 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5c33d0cf-6189-4433-b709-35903ceecc49 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:06 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5c33d0cf-6189-4433-b709-35903ceecc49 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:06 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5c33d0cf-6189-4433-b709-35903ceecc49 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:06 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5c33d0cf-6189-4433-b709-35903ceecc49 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:06 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5c33d0cf-6189-4433-b709-35903ceecc49 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:06 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5c33d0cf-6189-4433-b709-35903ceecc49 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:06 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-5c33d0cf-6189-4433-b709-35903ceecc49 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:48:06 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-5c33d0cf-6189-4433-b709-35903ceecc49 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749" status: 200 len: 1437 microversion: 2.1 time: 0.206824 Apr 12 00:48:06 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 274/829] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:48:06 2023] GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749 => generated 1437 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:48:07 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-4e6d01a6-3fdd-4e7a-877d-3949ca33b97b req-5770e72f-399e-43a7-ae76-f9273ed6b81c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7f4b0ac-f740-46b5-99f1-4129cccf1749", "tag": "6014f3cd-13ce-4fba-9cba-057192db2b3d"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:48:07 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4e6d01a6-3fdd-4e7a-877d-3949ca33b97b req-5770e72f-399e-43a7-ae76-f9273ed6b81c service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:07 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4e6d01a6-3fdd-4e7a-877d-3949ca33b97b req-5770e72f-399e-43a7-ae76-f9273ed6b81c service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:07 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4e6d01a6-3fdd-4e7a-877d-3949ca33b97b req-5770e72f-399e-43a7-ae76-f9273ed6b81c service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:07 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-4e6d01a6-3fdd-4e7a-877d-3949ca33b97b req-5770e72f-399e-43a7-ae76-f9273ed6b81c service nova] Creating event network-changed:6014f3cd-13ce-4fba-9cba-057192db2b3d for instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 on user Apr 12 00:48:07 user devstack@n-api.service[72496]: DEBUG nova.compute.api [req-4e6d01a6-3fdd-4e7a-877d-3949ca33b97b req-5770e72f-399e-43a7-ae76-f9273ed6b81c service nova] Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72496) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 00:48:07 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-4e6d01a6-3fdd-4e7a-877d-3949ca33b97b req-5770e72f-399e-43a7-ae76-f9273ed6b81c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037768 Apr 12 00:48:07 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 279/830] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:48:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:09 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-6cea745e-24a1-4a44-801c-a8b5251e68dc tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:09 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-6cea745e-24a1-4a44-801c-a8b5251e68dc tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-6cea745e-24a1-4a44-801c-a8b5251e68dc tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-6cea745e-24a1-4a44-801c-a8b5251e68dc tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-6cea745e-24a1-4a44-801c-a8b5251e68dc tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-6cea745e-24a1-4a44-801c-a8b5251e68dc tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-6cea745e-24a1-4a44-801c-a8b5251e68dc tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-6cea745e-24a1-4a44-801c-a8b5251e68dc tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:09 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-6cea745e-24a1-4a44-801c-a8b5251e68dc tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] HTTP exception thrown: Instance a346a131-2502-457a-acb8-8f903a7b87a7 could not be found. Apr 12 00:48:09 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-6cea745e-24a1-4a44-801c-a8b5251e68dc tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Request method failure captured: Apr 12 00:48:09 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7 HTTP/1.1 Apr 12 00:48:09 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:48:09 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:48:09 user devstack@n-api.service[72494]: Connection: close Apr 12 00:48:09 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:48:09 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:48:09 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:48:09 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:48:09 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:48:09 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNfx-yPB8Addd9whxbTRQOdN90sGir-xfc1IiR7-ECw56svld7JonHx7axp9WUmnT4KzR5TFzU-_uCRK58QPK_z1_aUm3UKF-xkJbrjTzJI02gd86EhzUOHFXsNSRIvLDd7tPEw_YsNig7FJnlwWFmOoZQqpImrudgWYdjbdfFy26et4 Apr 12 00:48:09 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:48:09 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:48:09 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:48:09 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:48:09 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:48:09 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:48:09 user devstack@n-api.service[72494]: X-Project-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:48:09 user devstack@n-api.service[72494]: X-Project-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:09 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:48:09 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:48:09 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b56f3c567dc84773a33d596920df727a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:48:09 user devstack@n-api.service[72494]: X-Tenant: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:09 user devstack@n-api.service[72494]: X-Tenant-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:48:09 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:09 user devstack@n-api.service[72494]: X-User: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:48:09 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:48:09 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:48:09 user devstack@n-api.service[72494]: X-User-Id: d373f582479c441e8ce9849ca694a186 Apr 12 00:48:09 user devstack@n-api.service[72494]: X-User-Name: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:48:09 user devstack@n-api.service[72494]: method: > Apr 12 00:48:09 user devstack@n-api.service[72494]: exception: Instance a346a131-2502-457a-acb8-8f903a7b87a7 could not be found. Apr 12 00:48:09 user devstack@n-api.service[72494]: action_args: {'id': 'a346a131-2502-457a-acb8-8f903a7b87a7'} Apr 12 00:48:09 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a346a131-2502-457a-acb8-8f903a7b87a7 could not be found. Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a346a131-2502-457a-acb8-8f903a7b87a7 could not be found. Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a346a131-2502-457a-acb8-8f903a7b87a7 could not be found. Apr 12 00:48:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:48:09 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-6cea745e-24a1-4a44-801c-a8b5251e68dc tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Returning 404 to user: Instance a346a131-2502-457a-acb8-8f903a7b87a7 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:48:09 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-6cea745e-24a1-4a44-801c-a8b5251e68dc tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7" status: 404 len: 111 microversion: 2.1 time: 0.033926 Apr 12 00:48:09 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 278/831] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:48:09 2023] GET /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:48:09 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-267dbbe9-7742-463b-85b7-014ac08d2ae6 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '.version_select at 0x7f7cd454bd00>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:09 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-267dbbe9-7742-463b-85b7-014ac08d2ae6 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1507461507" status: 202 len: 0 microversion: 2.1 time: 0.027523 Apr 12 00:48:09 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 275/832] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 00:48:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1507461507 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:48:09 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-2400b114-3a91-4741-b48b-34d6ba60e4dc req-5b135c1e-06c6-4f00-83aa-fa6e06164b18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f4b0ac-f740-46b5-99f1-4129cccf1749", "name": "network-vif-unplugged", "status": "completed", "tag": "6014f3cd-13ce-4fba-9cba-057192db2b3d"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:48:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2400b114-3a91-4741-b48b-34d6ba60e4dc req-5b135c1e-06c6-4f00-83aa-fa6e06164b18 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2400b114-3a91-4741-b48b-34d6ba60e4dc req-5b135c1e-06c6-4f00-83aa-fa6e06164b18 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2400b114-3a91-4741-b48b-34d6ba60e4dc req-5b135c1e-06c6-4f00-83aa-fa6e06164b18 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:09 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-2400b114-3a91-4741-b48b-34d6ba60e4dc req-5b135c1e-06c6-4f00-83aa-fa6e06164b18 service nova] Creating event network-vif-unplugged:6014f3cd-13ce-4fba-9cba-057192db2b3d for instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 on user Apr 12 00:48:09 user devstack@n-api.service[72496]: DEBUG nova.compute.api [req-2400b114-3a91-4741-b48b-34d6ba60e4dc req-5b135c1e-06c6-4f00-83aa-fa6e06164b18 service nova] Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72496) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 00:48:09 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-2400b114-3a91-4741-b48b-34d6ba60e4dc req-5b135c1e-06c6-4f00-83aa-fa6e06164b18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047686 Apr 12 00:48:09 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 280/833] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:48:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:11 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-e78a869c-a6e7-4b33-80c3-81b53abf0b65 req-cb563401-790d-4f9f-baca-6d8f5284374f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f4b0ac-f740-46b5-99f1-4129cccf1749", "name": "network-vif-plugged", "status": "completed", "tag": "6014f3cd-13ce-4fba-9cba-057192db2b3d"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:48:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-e78a869c-a6e7-4b33-80c3-81b53abf0b65 req-cb563401-790d-4f9f-baca-6d8f5284374f service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-e78a869c-a6e7-4b33-80c3-81b53abf0b65 req-cb563401-790d-4f9f-baca-6d8f5284374f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:11 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-e78a869c-a6e7-4b33-80c3-81b53abf0b65 req-cb563401-790d-4f9f-baca-6d8f5284374f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:11 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-e78a869c-a6e7-4b33-80c3-81b53abf0b65 req-cb563401-790d-4f9f-baca-6d8f5284374f service nova] Creating event network-vif-plugged:6014f3cd-13ce-4fba-9cba-057192db2b3d for instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 on user Apr 12 00:48:11 user devstack@n-api.service[72494]: DEBUG nova.compute.api [req-e78a869c-a6e7-4b33-80c3-81b53abf0b65 req-cb563401-790d-4f9f-baca-6d8f5284374f service nova] Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 00:48:11 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-e78a869c-a6e7-4b33-80c3-81b53abf0b65 req-cb563401-790d-4f9f-baca-6d8f5284374f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047551 Apr 12 00:48:11 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 279/834] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:48:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:12 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-6c125c4d-7a49-498f-bab9-4e46dfd446c8 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:12 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-6c125c4d-7a49-498f-bab9-4e46dfd446c8 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:12 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6c125c4d-7a49-498f-bab9-4e46dfd446c8 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:12 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6c125c4d-7a49-498f-bab9-4e46dfd446c8 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:12 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6c125c4d-7a49-498f-bab9-4e46dfd446c8 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:12 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6c125c4d-7a49-498f-bab9-4e46dfd446c8 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:12 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6c125c4d-7a49-498f-bab9-4e46dfd446c8 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:12 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6c125c4d-7a49-498f-bab9-4e46dfd446c8 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:12 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-6c125c4d-7a49-498f-bab9-4e46dfd446c8 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] HTTP exception thrown: Instance a346a131-2502-457a-acb8-8f903a7b87a7 could not be found. Apr 12 00:48:12 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-6c125c4d-7a49-498f-bab9-4e46dfd446c8 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Request method failure captured: Apr 12 00:48:12 user devstack@n-api.service[72495]: request: DELETE /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7 HTTP/1.1 Apr 12 00:48:12 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:48:12 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:48:12 user devstack@n-api.service[72495]: Connection: close Apr 12 00:48:12 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 00:48:12 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:48:12 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:48:12 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:48:12 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:48:12 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNfx-yPB8Addd9whxbTRQOdN90sGir-xfc1IiR7-ECw56svld7JonHx7axp9WUmnT4KzR5TFzU-_uCRK58QPK_z1_aUm3UKF-xkJbrjTzJI02gd86EhzUOHFXsNSRIvLDd7tPEw_YsNig7FJnlwWFmOoZQqpImrudgWYdjbdfFy26et4 Apr 12 00:48:12 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:48:12 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:48:12 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:48:12 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:48:12 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:48:12 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:48:12 user devstack@n-api.service[72495]: X-Project-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:48:12 user devstack@n-api.service[72495]: X-Project-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:12 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:48:12 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:48:12 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b56f3c567dc84773a33d596920df727a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:48:12 user devstack@n-api.service[72495]: X-Tenant: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:12 user devstack@n-api.service[72495]: X-Tenant-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:48:12 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:12 user devstack@n-api.service[72495]: X-User: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:48:12 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:48:12 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:48:12 user devstack@n-api.service[72495]: X-User-Id: d373f582479c441e8ce9849ca694a186 Apr 12 00:48:12 user devstack@n-api.service[72495]: X-User-Name: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:48:12 user devstack@n-api.service[72495]: method: > Apr 12 00:48:12 user devstack@n-api.service[72495]: exception: Instance a346a131-2502-457a-acb8-8f903a7b87a7 could not be found. Apr 12 00:48:12 user devstack@n-api.service[72495]: action_args: {'id': 'a346a131-2502-457a-acb8-8f903a7b87a7'} Apr 12 00:48:12 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a346a131-2502-457a-acb8-8f903a7b87a7 could not be found. Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a346a131-2502-457a-acb8-8f903a7b87a7 could not be found. Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a346a131-2502-457a-acb8-8f903a7b87a7 could not be found. Apr 12 00:48:12 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:12 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-6c125c4d-7a49-498f-bab9-4e46dfd446c8 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Returning 404 to user: Instance a346a131-2502-457a-acb8-8f903a7b87a7 could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:48:12 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-6c125c4d-7a49-498f-bab9-4e46dfd446c8 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7" status: 404 len: 111 microversion: 2.1 time: 0.033505 Apr 12 00:48:12 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 276/835] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:48:12 2023] DELETE /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:48:12 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-be147463-ec9e-4339-9633-d0bc37bd75b1 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:12 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-be147463-ec9e-4339-9633-d0bc37bd75b1 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: a346a131-2502-457a-acb8-8f903a7b87a7] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:12 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-be147463-ec9e-4339-9633-d0bc37bd75b1 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:12 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-be147463-ec9e-4339-9633-d0bc37bd75b1 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:12 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-be147463-ec9e-4339-9633-d0bc37bd75b1 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:12 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-be147463-ec9e-4339-9633-d0bc37bd75b1 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:12 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-be147463-ec9e-4339-9633-d0bc37bd75b1 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:12 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-be147463-ec9e-4339-9633-d0bc37bd75b1 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:12 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-be147463-ec9e-4339-9633-d0bc37bd75b1 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] HTTP exception thrown: Instance a346a131-2502-457a-acb8-8f903a7b87a7 could not be found. Apr 12 00:48:12 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-be147463-ec9e-4339-9633-d0bc37bd75b1 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Request method failure captured: Apr 12 00:48:12 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7 HTTP/1.1 Apr 12 00:48:12 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:48:12 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:48:12 user devstack@n-api.service[72496]: Connection: close Apr 12 00:48:12 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:48:12 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:48:12 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:48:12 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:48:12 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:48:12 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNfx-yPB8Addd9whxbTRQOdN90sGir-xfc1IiR7-ECw56svld7JonHx7axp9WUmnT4KzR5TFzU-_uCRK58QPK_z1_aUm3UKF-xkJbrjTzJI02gd86EhzUOHFXsNSRIvLDd7tPEw_YsNig7FJnlwWFmOoZQqpImrudgWYdjbdfFy26et4 Apr 12 00:48:12 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:48:12 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:48:12 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:48:12 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:48:12 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:48:12 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:48:12 user devstack@n-api.service[72496]: X-Project-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:48:12 user devstack@n-api.service[72496]: X-Project-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:12 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:48:12 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:48:12 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b56f3c567dc84773a33d596920df727a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:48:12 user devstack@n-api.service[72496]: X-Tenant: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:12 user devstack@n-api.service[72496]: X-Tenant-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:48:12 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:12 user devstack@n-api.service[72496]: X-User: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:48:12 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:48:12 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:48:12 user devstack@n-api.service[72496]: X-User-Id: d373f582479c441e8ce9849ca694a186 Apr 12 00:48:12 user devstack@n-api.service[72496]: X-User-Name: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:48:12 user devstack@n-api.service[72496]: method: > Apr 12 00:48:12 user devstack@n-api.service[72496]: exception: Instance a346a131-2502-457a-acb8-8f903a7b87a7 could not be found. Apr 12 00:48:12 user devstack@n-api.service[72496]: action_args: {'id': 'a346a131-2502-457a-acb8-8f903a7b87a7'} Apr 12 00:48:12 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a346a131-2502-457a-acb8-8f903a7b87a7 could not be found. Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a346a131-2502-457a-acb8-8f903a7b87a7 could not be found. Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a346a131-2502-457a-acb8-8f903a7b87a7 could not be found. Apr 12 00:48:12 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:48:12 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-be147463-ec9e-4339-9633-d0bc37bd75b1 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Returning 404 to user: Instance a346a131-2502-457a-acb8-8f903a7b87a7 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:48:12 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-be147463-ec9e-4339-9633-d0bc37bd75b1 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7" status: 404 len: 111 microversion: 2.1 time: 0.031476 Apr 12 00:48:12 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 281/836] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:48:12 2023] GET /compute/v2.1/servers/a346a131-2502-457a-acb8-8f903a7b87a7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:48:14 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-38db3dee-1299-44f9-b91a-630be7a575ed tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:14 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-38db3dee-1299-44f9-b91a-630be7a575ed tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-38db3dee-1299-44f9-b91a-630be7a575ed tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-38db3dee-1299-44f9-b91a-630be7a575ed tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-38db3dee-1299-44f9-b91a-630be7a575ed tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-38db3dee-1299-44f9-b91a-630be7a575ed tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-38db3dee-1299-44f9-b91a-630be7a575ed tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-38db3dee-1299-44f9-b91a-630be7a575ed tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:14 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-38db3dee-1299-44f9-b91a-630be7a575ed tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] HTTP exception thrown: Instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d could not be found. Apr 12 00:48:14 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-38db3dee-1299-44f9-b91a-630be7a575ed tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Request method failure captured: Apr 12 00:48:14 user devstack@n-api.service[72494]: request: DELETE /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d HTTP/1.1 Apr 12 00:48:14 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:48:14 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:48:14 user devstack@n-api.service[72494]: Connection: close Apr 12 00:48:14 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:48:14 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:48:14 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:48:14 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:48:14 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:48:14 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNfx-yPB8Addd9whxbTRQOdN90sGir-xfc1IiR7-ECw56svld7JonHx7axp9WUmnT4KzR5TFzU-_uCRK58QPK_z1_aUm3UKF-xkJbrjTzJI02gd86EhzUOHFXsNSRIvLDd7tPEw_YsNig7FJnlwWFmOoZQqpImrudgWYdjbdfFy26et4 Apr 12 00:48:14 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:48:14 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:48:14 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:48:14 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:48:14 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:48:14 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:48:14 user devstack@n-api.service[72494]: X-Project-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:48:14 user devstack@n-api.service[72494]: X-Project-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:14 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:48:14 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:48:14 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b56f3c567dc84773a33d596920df727a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:48:14 user devstack@n-api.service[72494]: X-Tenant: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:14 user devstack@n-api.service[72494]: X-Tenant-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:48:14 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:14 user devstack@n-api.service[72494]: X-User: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:48:14 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:48:14 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:48:14 user devstack@n-api.service[72494]: X-User-Id: d373f582479c441e8ce9849ca694a186 Apr 12 00:48:14 user devstack@n-api.service[72494]: X-User-Name: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:48:14 user devstack@n-api.service[72494]: method: > Apr 12 00:48:14 user devstack@n-api.service[72494]: exception: Instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d could not be found. Apr 12 00:48:14 user devstack@n-api.service[72494]: action_args: {'id': 'd677c2bb-77e2-40f3-8c3a-f15c9f75276d'} Apr 12 00:48:14 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d could not be found. Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d could not be found. Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d could not be found. Apr 12 00:48:14 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:48:14 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-38db3dee-1299-44f9-b91a-630be7a575ed tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Returning 404 to user: Instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:48:14 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-38db3dee-1299-44f9-b91a-630be7a575ed tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d" status: 404 len: 111 microversion: 2.1 time: 0.031247 Apr 12 00:48:14 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 280/837] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:48:14 2023] DELETE /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:48:14 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-1f57586a-d7c4-4cfe-9863-c1ec1f3518cc tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:14 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-1f57586a-d7c4-4cfe-9863-c1ec1f3518cc tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: d677c2bb-77e2-40f3-8c3a-f15c9f75276d] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1f57586a-d7c4-4cfe-9863-c1ec1f3518cc tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1f57586a-d7c4-4cfe-9863-c1ec1f3518cc tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1f57586a-d7c4-4cfe-9863-c1ec1f3518cc tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1f57586a-d7c4-4cfe-9863-c1ec1f3518cc tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1f57586a-d7c4-4cfe-9863-c1ec1f3518cc tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-1f57586a-d7c4-4cfe-9863-c1ec1f3518cc tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:14 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-1f57586a-d7c4-4cfe-9863-c1ec1f3518cc tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] HTTP exception thrown: Instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d could not be found. Apr 12 00:48:14 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-1f57586a-d7c4-4cfe-9863-c1ec1f3518cc tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Request method failure captured: Apr 12 00:48:14 user devstack@n-api.service[72495]: request: GET /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d HTTP/1.1 Apr 12 00:48:14 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:48:14 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:48:14 user devstack@n-api.service[72495]: Connection: close Apr 12 00:48:14 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 00:48:14 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:48:14 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:48:14 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:48:14 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:48:14 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNfx-yPB8Addd9whxbTRQOdN90sGir-xfc1IiR7-ECw56svld7JonHx7axp9WUmnT4KzR5TFzU-_uCRK58QPK_z1_aUm3UKF-xkJbrjTzJI02gd86EhzUOHFXsNSRIvLDd7tPEw_YsNig7FJnlwWFmOoZQqpImrudgWYdjbdfFy26et4 Apr 12 00:48:14 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:48:14 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:48:14 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:48:14 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:48:14 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:48:14 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:48:14 user devstack@n-api.service[72495]: X-Project-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:48:14 user devstack@n-api.service[72495]: X-Project-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:14 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:48:14 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:48:14 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b56f3c567dc84773a33d596920df727a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:48:14 user devstack@n-api.service[72495]: X-Tenant: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:14 user devstack@n-api.service[72495]: X-Tenant-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:48:14 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:14 user devstack@n-api.service[72495]: X-User: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:48:14 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:48:14 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:48:14 user devstack@n-api.service[72495]: X-User-Id: d373f582479c441e8ce9849ca694a186 Apr 12 00:48:14 user devstack@n-api.service[72495]: X-User-Name: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:48:14 user devstack@n-api.service[72495]: method: > Apr 12 00:48:14 user devstack@n-api.service[72495]: exception: Instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d could not be found. Apr 12 00:48:14 user devstack@n-api.service[72495]: action_args: {'id': 'd677c2bb-77e2-40f3-8c3a-f15c9f75276d'} Apr 12 00:48:14 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d could not be found. Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d could not be found. Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d could not be found. Apr 12 00:48:14 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:14 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-1f57586a-d7c4-4cfe-9863-c1ec1f3518cc tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Returning 404 to user: Instance d677c2bb-77e2-40f3-8c3a-f15c9f75276d could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:48:14 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-1f57586a-d7c4-4cfe-9863-c1ec1f3518cc tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d" status: 404 len: 111 microversion: 2.1 time: 0.034043 Apr 12 00:48:14 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 277/838] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:48:14 2023] GET /compute/v2.1/servers/d677c2bb-77e2-40f3-8c3a-f15c9f75276d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:48:15 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-5739c1fc-f5b3-4199-b2ed-d9dd4b5e61ca tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:15 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-5739c1fc-f5b3-4199-b2ed-d9dd4b5e61ca tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:15 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-5739c1fc-f5b3-4199-b2ed-d9dd4b5e61ca tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:15 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-5739c1fc-f5b3-4199-b2ed-d9dd4b5e61ca tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:15 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-5739c1fc-f5b3-4199-b2ed-d9dd4b5e61ca tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:15 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-5739c1fc-f5b3-4199-b2ed-d9dd4b5e61ca tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:15 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-5739c1fc-f5b3-4199-b2ed-d9dd4b5e61ca tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:15 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-5739c1fc-f5b3-4199-b2ed-d9dd4b5e61ca tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:15 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-5739c1fc-f5b3-4199-b2ed-d9dd4b5e61ca tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] HTTP exception thrown: Instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 could not be found. Apr 12 00:48:15 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-5739c1fc-f5b3-4199-b2ed-d9dd4b5e61ca tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Request method failure captured: Apr 12 00:48:15 user devstack@n-api.service[72496]: request: DELETE /compute/v2.1/servers/8fd7bb9c-9e20-49f2-8848-162a784b9885 HTTP/1.1 Apr 12 00:48:15 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:48:15 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:48:15 user devstack@n-api.service[72496]: Connection: close Apr 12 00:48:15 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:48:15 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:48:15 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:48:15 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:48:15 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:48:15 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNfx-yPB8Addd9whxbTRQOdN90sGir-xfc1IiR7-ECw56svld7JonHx7axp9WUmnT4KzR5TFzU-_uCRK58QPK_z1_aUm3UKF-xkJbrjTzJI02gd86EhzUOHFXsNSRIvLDd7tPEw_YsNig7FJnlwWFmOoZQqpImrudgWYdjbdfFy26et4 Apr 12 00:48:15 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:48:15 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:48:15 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:48:15 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:48:15 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:48:15 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:48:15 user devstack@n-api.service[72496]: X-Project-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:48:15 user devstack@n-api.service[72496]: X-Project-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:15 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:48:15 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:48:15 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b56f3c567dc84773a33d596920df727a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:48:15 user devstack@n-api.service[72496]: X-Tenant: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:15 user devstack@n-api.service[72496]: X-Tenant-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:48:15 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:15 user devstack@n-api.service[72496]: X-User: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:48:15 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:48:15 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:48:15 user devstack@n-api.service[72496]: X-User-Id: d373f582479c441e8ce9849ca694a186 Apr 12 00:48:15 user devstack@n-api.service[72496]: X-User-Name: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:48:15 user devstack@n-api.service[72496]: method: > Apr 12 00:48:15 user devstack@n-api.service[72496]: exception: Instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 could not be found. Apr 12 00:48:15 user devstack@n-api.service[72496]: action_args: {'id': '8fd7bb9c-9e20-49f2-8848-162a784b9885'} Apr 12 00:48:15 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 could not be found. Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 could not be found. Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 could not be found. Apr 12 00:48:15 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:48:15 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-5739c1fc-f5b3-4199-b2ed-d9dd4b5e61ca tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Returning 404 to user: Instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:48:15 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-5739c1fc-f5b3-4199-b2ed-d9dd4b5e61ca tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8fd7bb9c-9e20-49f2-8848-162a784b9885" status: 404 len: 111 microversion: 2.1 time: 0.031322 Apr 12 00:48:15 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 282/839] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:48:14 2023] DELETE /compute/v2.1/servers/8fd7bb9c-9e20-49f2-8848-162a784b9885 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:48:15 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-47de9c00-feb8-40c1-a84e-5a60d2843f52 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:15 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-47de9c00-feb8-40c1-a84e-5a60d2843f52 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 8fd7bb9c-9e20-49f2-8848-162a784b9885] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:15 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-47de9c00-feb8-40c1-a84e-5a60d2843f52 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:15 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-47de9c00-feb8-40c1-a84e-5a60d2843f52 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:15 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-47de9c00-feb8-40c1-a84e-5a60d2843f52 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:15 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-47de9c00-feb8-40c1-a84e-5a60d2843f52 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:15 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-47de9c00-feb8-40c1-a84e-5a60d2843f52 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:15 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-47de9c00-feb8-40c1-a84e-5a60d2843f52 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:15 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-47de9c00-feb8-40c1-a84e-5a60d2843f52 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] HTTP exception thrown: Instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 could not be found. Apr 12 00:48:15 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-47de9c00-feb8-40c1-a84e-5a60d2843f52 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Request method failure captured: Apr 12 00:48:15 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/8fd7bb9c-9e20-49f2-8848-162a784b9885 HTTP/1.1 Apr 12 00:48:15 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:48:15 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:48:15 user devstack@n-api.service[72494]: Connection: close Apr 12 00:48:15 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:48:15 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:48:15 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:48:15 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:48:15 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:48:15 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNfx-yPB8Addd9whxbTRQOdN90sGir-xfc1IiR7-ECw56svld7JonHx7axp9WUmnT4KzR5TFzU-_uCRK58QPK_z1_aUm3UKF-xkJbrjTzJI02gd86EhzUOHFXsNSRIvLDd7tPEw_YsNig7FJnlwWFmOoZQqpImrudgWYdjbdfFy26et4 Apr 12 00:48:15 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:48:15 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:48:15 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:48:15 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:48:15 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:48:15 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:48:15 user devstack@n-api.service[72494]: X-Project-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:48:15 user devstack@n-api.service[72494]: X-Project-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:15 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:48:15 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:48:15 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b56f3c567dc84773a33d596920df727a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:48:15 user devstack@n-api.service[72494]: X-Tenant: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:15 user devstack@n-api.service[72494]: X-Tenant-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:48:15 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:15 user devstack@n-api.service[72494]: X-User: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:48:15 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:48:15 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:48:15 user devstack@n-api.service[72494]: X-User-Id: d373f582479c441e8ce9849ca694a186 Apr 12 00:48:15 user devstack@n-api.service[72494]: X-User-Name: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:48:15 user devstack@n-api.service[72494]: method: > Apr 12 00:48:15 user devstack@n-api.service[72494]: exception: Instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 could not be found. Apr 12 00:48:15 user devstack@n-api.service[72494]: action_args: {'id': '8fd7bb9c-9e20-49f2-8848-162a784b9885'} Apr 12 00:48:15 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 could not be found. Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 could not be found. Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 could not be found. Apr 12 00:48:15 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:48:15 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-47de9c00-feb8-40c1-a84e-5a60d2843f52 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Returning 404 to user: Instance 8fd7bb9c-9e20-49f2-8848-162a784b9885 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:48:15 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-47de9c00-feb8-40c1-a84e-5a60d2843f52 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8fd7bb9c-9e20-49f2-8848-162a784b9885" status: 404 len: 111 microversion: 2.1 time: 0.027762 Apr 12 00:48:15 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 281/840] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:48:15 2023] GET /compute/v2.1/servers/8fd7bb9c-9e20-49f2-8848-162a784b9885 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:48:17 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-6de51f48-0488-4832-8f9a-dd7926f04496 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:17 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-6de51f48-0488-4832-8f9a-dd7926f04496 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6de51f48-0488-4832-8f9a-dd7926f04496 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6de51f48-0488-4832-8f9a-dd7926f04496 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6de51f48-0488-4832-8f9a-dd7926f04496 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6de51f48-0488-4832-8f9a-dd7926f04496 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6de51f48-0488-4832-8f9a-dd7926f04496 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6de51f48-0488-4832-8f9a-dd7926f04496 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:17 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-6de51f48-0488-4832-8f9a-dd7926f04496 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] HTTP exception thrown: Instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a could not be found. Apr 12 00:48:17 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-6de51f48-0488-4832-8f9a-dd7926f04496 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Request method failure captured: Apr 12 00:48:17 user devstack@n-api.service[72495]: request: DELETE /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a HTTP/1.1 Apr 12 00:48:17 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:48:17 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:48:17 user devstack@n-api.service[72495]: Connection: close Apr 12 00:48:17 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 00:48:17 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:48:17 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:48:17 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:48:17 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:48:17 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNfx-yPB8Addd9whxbTRQOdN90sGir-xfc1IiR7-ECw56svld7JonHx7axp9WUmnT4KzR5TFzU-_uCRK58QPK_z1_aUm3UKF-xkJbrjTzJI02gd86EhzUOHFXsNSRIvLDd7tPEw_YsNig7FJnlwWFmOoZQqpImrudgWYdjbdfFy26et4 Apr 12 00:48:17 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:48:17 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:48:17 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:48:17 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:48:17 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:48:17 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:48:17 user devstack@n-api.service[72495]: X-Project-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:48:17 user devstack@n-api.service[72495]: X-Project-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:17 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:48:17 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:48:17 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b56f3c567dc84773a33d596920df727a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:48:17 user devstack@n-api.service[72495]: X-Tenant: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:17 user devstack@n-api.service[72495]: X-Tenant-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:48:17 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:17 user devstack@n-api.service[72495]: X-User: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:48:17 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:48:17 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:48:17 user devstack@n-api.service[72495]: X-User-Id: d373f582479c441e8ce9849ca694a186 Apr 12 00:48:17 user devstack@n-api.service[72495]: X-User-Name: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:48:17 user devstack@n-api.service[72495]: method: > Apr 12 00:48:17 user devstack@n-api.service[72495]: exception: Instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a could not be found. Apr 12 00:48:17 user devstack@n-api.service[72495]: action_args: {'id': '2bae2f38-fd5e-4d51-be63-22bbf54cd77a'} Apr 12 00:48:17 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a could not be found. Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a could not be found. Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a could not be found. Apr 12 00:48:17 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:17 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-6de51f48-0488-4832-8f9a-dd7926f04496 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Returning 404 to user: Instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:48:17 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-6de51f48-0488-4832-8f9a-dd7926f04496 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a" status: 404 len: 111 microversion: 2.1 time: 0.030613 Apr 12 00:48:17 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 278/841] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:48:17 2023] DELETE /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:48:17 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-602becfb-f948-4275-9193-9dfb9a9b57f5 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:17 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-602becfb-f948-4275-9193-9dfb9a9b57f5 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] [instance: 2bae2f38-fd5e-4d51-be63-22bbf54cd77a] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-602becfb-f948-4275-9193-9dfb9a9b57f5 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-602becfb-f948-4275-9193-9dfb9a9b57f5 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-602becfb-f948-4275-9193-9dfb9a9b57f5 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-602becfb-f948-4275-9193-9dfb9a9b57f5 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-602becfb-f948-4275-9193-9dfb9a9b57f5 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-602becfb-f948-4275-9193-9dfb9a9b57f5 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:17 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-602becfb-f948-4275-9193-9dfb9a9b57f5 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] HTTP exception thrown: Instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a could not be found. Apr 12 00:48:17 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-602becfb-f948-4275-9193-9dfb9a9b57f5 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Request method failure captured: Apr 12 00:48:17 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a HTTP/1.1 Apr 12 00:48:17 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:48:17 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:48:17 user devstack@n-api.service[72496]: Connection: close Apr 12 00:48:17 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:48:17 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:48:17 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:48:17 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:48:17 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:48:17 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNfx-yPB8Addd9whxbTRQOdN90sGir-xfc1IiR7-ECw56svld7JonHx7axp9WUmnT4KzR5TFzU-_uCRK58QPK_z1_aUm3UKF-xkJbrjTzJI02gd86EhzUOHFXsNSRIvLDd7tPEw_YsNig7FJnlwWFmOoZQqpImrudgWYdjbdfFy26et4 Apr 12 00:48:17 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:48:17 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:48:17 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:48:17 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:48:17 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:48:17 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:48:17 user devstack@n-api.service[72496]: X-Project-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:48:17 user devstack@n-api.service[72496]: X-Project-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:17 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:48:17 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:48:17 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b56f3c567dc84773a33d596920df727a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b56f3c567dc84773a33d596920df727a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:48:17 user devstack@n-api.service[72496]: X-Tenant: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:17 user devstack@n-api.service[72496]: X-Tenant-Id: b56f3c567dc84773a33d596920df727a Apr 12 00:48:17 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2076679017 Apr 12 00:48:17 user devstack@n-api.service[72496]: X-User: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:48:17 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:48:17 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:48:17 user devstack@n-api.service[72496]: X-User-Id: d373f582479c441e8ce9849ca694a186 Apr 12 00:48:17 user devstack@n-api.service[72496]: X-User-Name: tempest-AttachVolumeNegativeTest-2076679017-project-member Apr 12 00:48:17 user devstack@n-api.service[72496]: method: > Apr 12 00:48:17 user devstack@n-api.service[72496]: exception: Instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a could not be found. Apr 12 00:48:17 user devstack@n-api.service[72496]: action_args: {'id': '2bae2f38-fd5e-4d51-be63-22bbf54cd77a'} Apr 12 00:48:17 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a could not be found. Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a could not be found. Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a could not be found. Apr 12 00:48:17 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:48:17 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-602becfb-f948-4275-9193-9dfb9a9b57f5 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] Returning 404 to user: Instance 2bae2f38-fd5e-4d51-be63-22bbf54cd77a could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:48:17 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-602becfb-f948-4275-9193-9dfb9a9b57f5 tempest-AttachVolumeNegativeTest-2076679017 tempest-AttachVolumeNegativeTest-2076679017-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a" status: 404 len: 111 microversion: 2.1 time: 0.026808 Apr 12 00:48:17 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 283/842] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:48:17 2023] GET /compute/v2.1/servers/2bae2f38-fd5e-4d51-be63-22bbf54cd77a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:48:18 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-07e0b5f7-5ad8-4217-9d77-1ee8208abf9c tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:18 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-07e0b5f7-5ad8-4217-9d77-1ee8208abf9c tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:18 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=3 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:48:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-07e0b5f7-5ad8-4217-9d77-1ee8208abf9c tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-07e0b5f7-5ad8-4217-9d77-1ee8208abf9c tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-07e0b5f7-5ad8-4217-9d77-1ee8208abf9c tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-07e0b5f7-5ad8-4217-9d77-1ee8208abf9c tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-07e0b5f7-5ad8-4217-9d77-1ee8208abf9c tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-07e0b5f7-5ad8-4217-9d77-1ee8208abf9c tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:19 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-07e0b5f7-5ad8-4217-9d77-1ee8208abf9c tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842535891eb4a9880f7e8859dd0de3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66fda80cb83402392e155c76ee78e1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:48:19 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-07e0b5f7-5ad8-4217-9d77-1ee8208abf9c tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90" status: 200 len: 1534 microversion: 2.1 time: 0.251461 Apr 12 00:48:19 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 282/843] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:48:18 2023] GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90 => generated 1534 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:48:19 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-42513b0e-3838-467c-a05e-76d9a2674f53 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:19 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-42513b0e-3838-467c-a05e-76d9a2674f53 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2842535891eb4a9880f7e8859dd0de3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66fda80cb83402392e155c76ee78e1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:48:19 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-42513b0e-3838-467c-a05e-76d9a2674f53 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Searching by: {'deleted': False, 'project_id': 'e66fda80cb83402392e155c76ee78e1f'} {{(pid=72495) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 12 00:48:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-42513b0e-3838-467c-a05e-76d9a2674f53 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-42513b0e-3838-467c-a05e-76d9a2674f53 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-42513b0e-3838-467c-a05e-76d9a2674f53 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-42513b0e-3838-467c-a05e-76d9a2674f53 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-42513b0e-3838-467c-a05e-76d9a2674f53 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-42513b0e-3838-467c-a05e-76d9a2674f53 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:19 user devstack@n-api.service[72495]: DEBUG nova.compute.multi_cell_list [None req-42513b0e-3838-467c-a05e-76d9a2674f53 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=72495) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 12 00:48:19 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-42513b0e-3838-467c-a05e-76d9a2674f53 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.246164 Apr 12 00:48:19 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 279/844] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 12 00:48:19 2023] GET /compute/v2.1/servers => generated 340 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:19 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-c0edeee6-d936-4d11-ab05-d0599d3537ed tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:19 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-c0edeee6-d936-4d11-ab05-d0599d3537ed tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c0edeee6-d936-4d11-ab05-d0599d3537ed tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c0edeee6-d936-4d11-ab05-d0599d3537ed tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c0edeee6-d936-4d11-ab05-d0599d3537ed tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c0edeee6-d936-4d11-ab05-d0599d3537ed tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c0edeee6-d936-4d11-ab05-d0599d3537ed tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c0edeee6-d936-4d11-ab05-d0599d3537ed tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:19 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-d822fd58-44d3-4aef-b2d3-d9a4c988049e req-060745a8-7ea0-49df-8481-ce6f038748bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f4b0ac-f740-46b5-99f1-4129cccf1749", "name": "network-vif-plugged", "status": "completed", "tag": "6014f3cd-13ce-4fba-9cba-057192db2b3d"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:48:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-d822fd58-44d3-4aef-b2d3-d9a4c988049e req-060745a8-7ea0-49df-8481-ce6f038748bb service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-d822fd58-44d3-4aef-b2d3-d9a4c988049e req-060745a8-7ea0-49df-8481-ce6f038748bb service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-d822fd58-44d3-4aef-b2d3-d9a4c988049e req-060745a8-7ea0-49df-8481-ce6f038748bb service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:19 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-d822fd58-44d3-4aef-b2d3-d9a4c988049e req-060745a8-7ea0-49df-8481-ce6f038748bb service nova] Creating event network-vif-plugged:6014f3cd-13ce-4fba-9cba-057192db2b3d for instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 on user Apr 12 00:48:19 user devstack@n-api.service[72494]: DEBUG nova.compute.api [req-d822fd58-44d3-4aef-b2d3-d9a4c988049e req-060745a8-7ea0-49df-8481-ce6f038748bb service nova] Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 00:48:19 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-d822fd58-44d3-4aef-b2d3-d9a4c988049e req-060745a8-7ea0-49df-8481-ce6f038748bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036937 Apr 12 00:48:19 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 283/845] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:48:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:19 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-c0edeee6-d936-4d11-ab05-d0599d3537ed tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842535891eb4a9880f7e8859dd0de3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66fda80cb83402392e155c76ee78e1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:48:19 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-c0edeee6-d936-4d11-ab05-d0599d3537ed tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90" status: 200 len: 1534 microversion: 2.1 time: 0.250087 Apr 12 00:48:19 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 284/846] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:48:19 2023] GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90 => generated 1534 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:48:21 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35254bb1-a5b6-4517-96c9-7d1df42532a5"}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:48:21 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:21 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-2dc6983d-8c92-4b19-844e-3995731cdd71 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318214 Apr 12 00:48:21 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 280/847] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 00:48:21 2023] POST /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:21 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-a025a5a2-5bdc-4b62-ae49-fd9c1b182e02 req-5c6574b7-56ef-44ec-8eab-cb3124b3519f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f4b0ac-f740-46b5-99f1-4129cccf1749", "name": "network-vif-plugged", "status": "completed", "tag": "6014f3cd-13ce-4fba-9cba-057192db2b3d"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:48:21 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-a025a5a2-5bdc-4b62-ae49-fd9c1b182e02 req-5c6574b7-56ef-44ec-8eab-cb3124b3519f service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:21 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-a025a5a2-5bdc-4b62-ae49-fd9c1b182e02 req-5c6574b7-56ef-44ec-8eab-cb3124b3519f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:21 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-a025a5a2-5bdc-4b62-ae49-fd9c1b182e02 req-5c6574b7-56ef-44ec-8eab-cb3124b3519f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:21 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-a025a5a2-5bdc-4b62-ae49-fd9c1b182e02 req-5c6574b7-56ef-44ec-8eab-cb3124b3519f service nova] Creating event network-vif-plugged:6014f3cd-13ce-4fba-9cba-057192db2b3d for instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 on user Apr 12 00:48:21 user devstack@n-api.service[72494]: DEBUG nova.compute.api [req-a025a5a2-5bdc-4b62-ae49-fd9c1b182e02 req-5c6574b7-56ef-44ec-8eab-cb3124b3519f service nova] Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=72494) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 00:48:21 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-a025a5a2-5bdc-4b62-ae49-fd9c1b182e02 req-5c6574b7-56ef-44ec-8eab-cb3124b3519f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039175 Apr 12 00:48:21 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 284/848] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:48:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:22 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-33a364ac-ebc3-43af-8bb4-61278ed71fec tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Action: 'create', calling method: .version_select at 0x7f7cd44769e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2011299156"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:48:22 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-33a364ac-ebc3-43af-8bb4-61278ed71fec tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.503328 Apr 12 00:48:22 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 285/849] 10.0.0.210 () {64 vars in 1232 bytes} [Wed Apr 12 00:48:21 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 505 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 12 00:48:22 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-bfe824d4-d7a4-45d9-afe3-e300d555f72f tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Calling method '.version_select at 0x7f7cd45b6c20>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:22 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-bfe824d4-d7a4-45d9-afe3-e300d555f72f tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e" status: 200 len: 345 microversion: 2.1 time: 0.064391 Apr 12 00:48:22 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 281/850] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 00:48:22 2023] GET /compute/v2.1/os-volumes/8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:23 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-8ffb61c0-2a50-4c7d-a958-c21bfa183db7 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Calling method '.version_select at 0x7f7cd46e8310>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:23 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-8ffb61c0-2a50-4c7d-a958-c21bfa183db7 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e" status: 200 len: 346 microversion: 2.1 time: 0.103913 Apr 12 00:48:23 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 285/851] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 00:48:23 2023] GET /compute/v2.1/os-volumes/8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e => generated 346 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:23 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-caa3a52b-c797-465e-93b0-20ba95972c1f tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Action: 'create', calling method: .version_select at 0x7f7cd4a15090>, body: {"snapshot": {"volume_id": "8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1405989326"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:48:23 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-caa3a52b-c797-465e-93b0-20ba95972c1f tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.227151 Apr 12 00:48:23 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 286/852] 10.0.0.210 () {64 vars in 1239 bytes} [Wed Apr 12 00:48:23 2023] POST /compute/v2.1/os-snapshots => generated 287 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:48:23 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-328ff383-50a0-4024-b319-0350c6b1e650 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Calling method '.version_select at 0x7f7cd45b63b0>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:23 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-328ff383-50a0-4024-b319-0350c6b1e650 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/0a69ed5f-2d8e-4fe7-be75-e230dcbed9a3" status: 200 len: 287 microversion: 2.1 time: 0.050404 Apr 12 00:48:23 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 282/853] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 00:48:23 2023] GET /compute/v2.1/os-snapshots/0a69ed5f-2d8e-4fe7-be75-e230dcbed9a3 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:23 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-0c458867-b021-45ca-9049-78cfe8942199 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Calling method '.version_select at 0x7f7cd46e9f30>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:24 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-0c458867-b021-45ca-9049-78cfe8942199 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.045903 Apr 12 00:48:24 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 286/854] 10.0.0.210 () {62 vars in 1217 bytes} [Wed Apr 12 00:48:23 2023] GET /compute/v2.1/os-snapshots => generated 290 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:24 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-a622c2da-937f-46de-adc2-d5780845fdef tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Calling method '.version_select at 0x7f7cd43184c0>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:24 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-a622c2da-937f-46de-adc2-d5780845fdef tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/0a69ed5f-2d8e-4fe7-be75-e230dcbed9a3" status: 200 len: 287 microversion: 2.1 time: 0.040926 Apr 12 00:48:24 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 287/855] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 00:48:24 2023] GET /compute/v2.1/os-snapshots/0a69ed5f-2d8e-4fe7-be75-e230dcbed9a3 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:25 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-9c8915c5-f546-4c42-91ac-7f5161304577 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Calling method '.version_select at 0x7f7cd45b4040>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:25 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-9c8915c5-f546-4c42-91ac-7f5161304577 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/0a69ed5f-2d8e-4fe7-be75-e230dcbed9a3" status: 200 len: 288 microversion: 2.1 time: 0.035519 Apr 12 00:48:25 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 283/856] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 00:48:25 2023] GET /compute/v2.1/os-snapshots/0a69ed5f-2d8e-4fe7-be75-e230dcbed9a3 => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:25 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-1bb62bc4-5bc4-46c6-b448-d796fa583918 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Calling method '.version_select at 0x7f7cd46e8b80>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:25 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-1bb62bc4-5bc4-46c6-b448-d796fa583918 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/0a69ed5f-2d8e-4fe7-be75-e230dcbed9a3" status: 202 len: 0 microversion: 2.1 time: 0.072969 Apr 12 00:48:25 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 287/857] 10.0.0.210 () {62 vars in 1331 bytes} [Wed Apr 12 00:48:25 2023] DELETE /compute/v2.1/os-snapshots/0a69ed5f-2d8e-4fe7-be75-e230dcbed9a3 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:48:25 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-7bef7579-8740-4129-9bae-64baea4413af tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Calling method '.version_select at 0x7f7cd4477910>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:25 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-7bef7579-8740-4129-9bae-64baea4413af tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/0a69ed5f-2d8e-4fe7-be75-e230dcbed9a3" status: 200 len: 287 microversion: 2.1 time: 0.045773 Apr 12 00:48:25 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 288/858] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 00:48:25 2023] GET /compute/v2.1/os-snapshots/0a69ed5f-2d8e-4fe7-be75-e230dcbed9a3 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:26 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-db1cbf2a-d00d-4a0f-9ca4-aa1af4d95f3c tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Calling method '.version_select at 0x7f7cd454b2e0>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:26 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-db1cbf2a-d00d-4a0f-9ca4-aa1af4d95f3c tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] HTTP exception thrown: Snapshot 0a69ed5f-2d8e-4fe7-be75-e230dcbed9a3 could not be found. Apr 12 00:48:26 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-db1cbf2a-d00d-4a0f-9ca4-aa1af4d95f3c tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Request method failure captured: Apr 12 00:48:26 user devstack@n-api.service[72495]: request: GET /compute/v2.1/os-snapshots/0a69ed5f-2d8e-4fe7-be75-e230dcbed9a3 HTTP/1.1 Apr 12 00:48:26 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:48:26 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:48:26 user devstack@n-api.service[72495]: Connection: close Apr 12 00:48:26 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 00:48:26 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:48:26 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:48:26 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:48:26 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:48:26 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNf_VCX3rPtVFnIdLEMDIc8xJ8GmwyHIqvzxlA6TDDxBnFC-Y1I5lMsJkvWki_ODrTlXNgk0tKFt-lUcYB4wskxiIeUPr1YZa1gQVQzDyD6lHPJdeCCgfDXG5DGo5oLUmJCOYXW6Vwc6rAUQk-u0wTcqbuNLiifAAAmb2WYM3ZXdSaXk Apr 12 00:48:26 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:48:26 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:48:26 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:48:26 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:48:26 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:48:26 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:48:26 user devstack@n-api.service[72495]: X-Project-Id: 3a8683cf83d0436ab247fb4c72bf206b Apr 12 00:48:26 user devstack@n-api.service[72495]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-920806094 Apr 12 00:48:26 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:48:26 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:48:26 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a8683cf83d0436ab247fb4c72bf206b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3a8683cf83d0436ab247fb4c72bf206b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a8683cf83d0436ab247fb4c72bf206b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:48:26 user devstack@n-api.service[72495]: X-Tenant: tempest-VolumesSnapshotsTestJSON-920806094 Apr 12 00:48:26 user devstack@n-api.service[72495]: X-Tenant-Id: 3a8683cf83d0436ab247fb4c72bf206b Apr 12 00:48:26 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-920806094 Apr 12 00:48:26 user devstack@n-api.service[72495]: X-User: tempest-VolumesSnapshotsTestJSON-920806094-project-member Apr 12 00:48:26 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:48:26 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:48:26 user devstack@n-api.service[72495]: X-User-Id: 18843a1e6f954fc897091fa9f02914a4 Apr 12 00:48:26 user devstack@n-api.service[72495]: X-User-Name: tempest-VolumesSnapshotsTestJSON-920806094-project-member Apr 12 00:48:26 user devstack@n-api.service[72495]: method: Apr 12 00:48:26 user devstack@n-api.service[72495]: exception: Snapshot 0a69ed5f-2d8e-4fe7-be75-e230dcbed9a3 could not be found. Apr 12 00:48:26 user devstack@n-api.service[72495]: action_args: {'id': '0a69ed5f-2d8e-4fe7-be75-e230dcbed9a3'} Apr 12 00:48:26 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0a69ed5f-2d8e-4fe7-be75-e230dcbed9a3 could not be found. (HTTP 404) (Request-ID: req-0ab316a0-7da5-43df-93af-66712e0ce021) Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0a69ed5f-2d8e-4fe7-be75-e230dcbed9a3 could not be found. Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0a69ed5f-2d8e-4fe7-be75-e230dcbed9a3 could not be found. Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0a69ed5f-2d8e-4fe7-be75-e230dcbed9a3 could not be found. Apr 12 00:48:26 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:26 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-db1cbf2a-d00d-4a0f-9ca4-aa1af4d95f3c tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Returning 404 to user: Snapshot 0a69ed5f-2d8e-4fe7-be75-e230dcbed9a3 could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:48:26 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-db1cbf2a-d00d-4a0f-9ca4-aa1af4d95f3c tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/0a69ed5f-2d8e-4fe7-be75-e230dcbed9a3" status: 404 len: 111 microversion: 2.1 time: 0.038326 Apr 12 00:48:26 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 284/859] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 00:48:26 2023] GET /compute/v2.1/os-snapshots/0a69ed5f-2d8e-4fe7-be75-e230dcbed9a3 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:48:26 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-06a8bf53-44ff-4fe4-a27d-e775fe3cdc77 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Calling method '.version_select at 0x7f7cd4619c60>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:26 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-06a8bf53-44ff-4fe4-a27d-e775fe3cdc77 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e" status: 202 len: 0 microversion: 2.1 time: 0.081474 Apr 12 00:48:26 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 288/860] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 00:48:26 2023] DELETE /compute/v2.1/os-volumes/8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:48:26 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-f5a24c30-0fe3-4af2-86f2-8f6b7acb7040 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Calling method '.version_select at 0x7f7cd4318b80>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:26 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-f5a24c30-0fe3-4af2-86f2-8f6b7acb7040 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e" status: 200 len: 345 microversion: 2.1 time: 0.060308 Apr 12 00:48:26 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 289/861] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 00:48:26 2023] GET /compute/v2.1/os-volumes/8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:27 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-1af6f69b-e8ee-4ca5-8c8b-7b8216fe1f53 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Calling method '.version_select at 0x7f7cd45b6c20>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:27 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-1af6f69b-e8ee-4ca5-8c8b-7b8216fe1f53 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e" status: 200 len: 345 microversion: 2.1 time: 0.051431 Apr 12 00:48:27 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 285/862] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 00:48:27 2023] GET /compute/v2.1/os-volumes/8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:28 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-87f75dbf-4580-4c66-8da5-5d5e4eadcaa7 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Calling method '.version_select at 0x7f7cd46e80d0>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:28 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-87f75dbf-4580-4c66-8da5-5d5e4eadcaa7 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] HTTP exception thrown: Volume 8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e could not be found. Apr 12 00:48:28 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-87f75dbf-4580-4c66-8da5-5d5e4eadcaa7 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Request method failure captured: Apr 12 00:48:28 user devstack@n-api.service[72494]: request: GET /compute/v2.1/os-volumes/8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e HTTP/1.1 Apr 12 00:48:28 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:48:28 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:48:28 user devstack@n-api.service[72494]: Connection: close Apr 12 00:48:28 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:48:28 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:48:28 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:48:28 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:48:28 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:48:28 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNf_VCX3rPtVFnIdLEMDIc8xJ8GmwyHIqvzxlA6TDDxBnFC-Y1I5lMsJkvWki_ODrTlXNgk0tKFt-lUcYB4wskxiIeUPr1YZa1gQVQzDyD6lHPJdeCCgfDXG5DGo5oLUmJCOYXW6Vwc6rAUQk-u0wTcqbuNLiifAAAmb2WYM3ZXdSaXk Apr 12 00:48:28 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:48:28 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:48:28 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:48:28 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:48:28 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:48:28 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:48:28 user devstack@n-api.service[72494]: X-Project-Id: 3a8683cf83d0436ab247fb4c72bf206b Apr 12 00:48:28 user devstack@n-api.service[72494]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-920806094 Apr 12 00:48:28 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:48:28 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:48:28 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a8683cf83d0436ab247fb4c72bf206b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3a8683cf83d0436ab247fb4c72bf206b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a8683cf83d0436ab247fb4c72bf206b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:48:28 user devstack@n-api.service[72494]: X-Tenant: tempest-VolumesSnapshotsTestJSON-920806094 Apr 12 00:48:28 user devstack@n-api.service[72494]: X-Tenant-Id: 3a8683cf83d0436ab247fb4c72bf206b Apr 12 00:48:28 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-920806094 Apr 12 00:48:28 user devstack@n-api.service[72494]: X-User: tempest-VolumesSnapshotsTestJSON-920806094-project-member Apr 12 00:48:28 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:48:28 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:48:28 user devstack@n-api.service[72494]: X-User-Id: 18843a1e6f954fc897091fa9f02914a4 Apr 12 00:48:28 user devstack@n-api.service[72494]: X-User-Name: tempest-VolumesSnapshotsTestJSON-920806094-project-member Apr 12 00:48:28 user devstack@n-api.service[72494]: method: Apr 12 00:48:28 user devstack@n-api.service[72494]: exception: Volume 8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e could not be found. Apr 12 00:48:28 user devstack@n-api.service[72494]: action_args: {'id': '8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e'} Apr 12 00:48:28 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e could not be found. (HTTP 404) (Request-ID: req-813aceb0-f243-43c4-ab28-9275ce24c7de) Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e could not be found. Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e could not be found. Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e could not be found. Apr 12 00:48:28 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:48:28 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-87f75dbf-4580-4c66-8da5-5d5e4eadcaa7 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Returning 404 to user: Volume 8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:48:28 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-87f75dbf-4580-4c66-8da5-5d5e4eadcaa7 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e" status: 404 len: 109 microversion: 2.1 time: 0.038683 Apr 12 00:48:28 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 289/863] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 00:48:28 2023] GET /compute/v2.1/os-volumes/8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:48:28 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-453c5966-c90d-485c-8082-715d9c11a673 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Calling method '.version_select at 0x7f7cd4670a60>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:28 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-453c5966-c90d-485c-8082-715d9c11a673 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] HTTP exception thrown: Volume 8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e could not be found. Apr 12 00:48:28 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-453c5966-c90d-485c-8082-715d9c11a673 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Request method failure captured: Apr 12 00:48:28 user devstack@n-api.service[72496]: request: DELETE /compute/v2.1/os-volumes/8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e HTTP/1.1 Apr 12 00:48:28 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:48:28 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:48:28 user devstack@n-api.service[72496]: Connection: close Apr 12 00:48:28 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:48:28 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:48:28 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:48:28 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:48:28 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:48:28 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNf_VCX3rPtVFnIdLEMDIc8xJ8GmwyHIqvzxlA6TDDxBnFC-Y1I5lMsJkvWki_ODrTlXNgk0tKFt-lUcYB4wskxiIeUPr1YZa1gQVQzDyD6lHPJdeCCgfDXG5DGo5oLUmJCOYXW6Vwc6rAUQk-u0wTcqbuNLiifAAAmb2WYM3ZXdSaXk Apr 12 00:48:28 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:48:28 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:48:28 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:48:28 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:48:28 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:48:28 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:48:28 user devstack@n-api.service[72496]: X-Project-Id: 3a8683cf83d0436ab247fb4c72bf206b Apr 12 00:48:28 user devstack@n-api.service[72496]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-920806094 Apr 12 00:48:28 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:48:28 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:48:28 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a8683cf83d0436ab247fb4c72bf206b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3a8683cf83d0436ab247fb4c72bf206b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a8683cf83d0436ab247fb4c72bf206b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:48:28 user devstack@n-api.service[72496]: X-Tenant: tempest-VolumesSnapshotsTestJSON-920806094 Apr 12 00:48:28 user devstack@n-api.service[72496]: X-Tenant-Id: 3a8683cf83d0436ab247fb4c72bf206b Apr 12 00:48:28 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-920806094 Apr 12 00:48:28 user devstack@n-api.service[72496]: X-User: tempest-VolumesSnapshotsTestJSON-920806094-project-member Apr 12 00:48:28 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:48:28 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:48:28 user devstack@n-api.service[72496]: X-User-Id: 18843a1e6f954fc897091fa9f02914a4 Apr 12 00:48:28 user devstack@n-api.service[72496]: X-User-Name: tempest-VolumesSnapshotsTestJSON-920806094-project-member Apr 12 00:48:28 user devstack@n-api.service[72496]: method: Apr 12 00:48:28 user devstack@n-api.service[72496]: exception: Volume 8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e could not be found. Apr 12 00:48:28 user devstack@n-api.service[72496]: action_args: {'id': '8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e'} Apr 12 00:48:28 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e could not be found. (HTTP 404) (Request-ID: req-16996181-9bb0-4c91-994e-c04653388144) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e could not be found. Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e could not be found. Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e could not be found. Apr 12 00:48:28 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:48:28 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-453c5966-c90d-485c-8082-715d9c11a673 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Returning 404 to user: Volume 8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:48:28 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-453c5966-c90d-485c-8082-715d9c11a673 tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e" status: 404 len: 109 microversion: 2.1 time: 0.036053 Apr 12 00:48:28 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 290/864] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 00:48:28 2023] DELETE /compute/v2.1/os-volumes/8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:48:28 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-6c333db6-8100-4632-8f86-d491d610282a tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Calling method '.version_select at 0x7f7cd4429870>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:28 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-6c333db6-8100-4632-8f86-d491d610282a tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] HTTP exception thrown: Volume 8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e could not be found. Apr 12 00:48:28 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-6c333db6-8100-4632-8f86-d491d610282a tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Request method failure captured: Apr 12 00:48:28 user devstack@n-api.service[72495]: request: GET /compute/v2.1/os-volumes/8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e HTTP/1.1 Apr 12 00:48:28 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:48:28 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:48:28 user devstack@n-api.service[72495]: Connection: close Apr 12 00:48:28 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 00:48:28 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:48:28 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:48:28 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:48:28 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:48:28 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNf_VCX3rPtVFnIdLEMDIc8xJ8GmwyHIqvzxlA6TDDxBnFC-Y1I5lMsJkvWki_ODrTlXNgk0tKFt-lUcYB4wskxiIeUPr1YZa1gQVQzDyD6lHPJdeCCgfDXG5DGo5oLUmJCOYXW6Vwc6rAUQk-u0wTcqbuNLiifAAAmb2WYM3ZXdSaXk Apr 12 00:48:28 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:48:28 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:48:28 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:48:28 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:48:28 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:48:28 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:48:28 user devstack@n-api.service[72495]: X-Project-Id: 3a8683cf83d0436ab247fb4c72bf206b Apr 12 00:48:28 user devstack@n-api.service[72495]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-920806094 Apr 12 00:48:28 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:48:28 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:48:28 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a8683cf83d0436ab247fb4c72bf206b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3a8683cf83d0436ab247fb4c72bf206b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a8683cf83d0436ab247fb4c72bf206b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:48:28 user devstack@n-api.service[72495]: X-Tenant: tempest-VolumesSnapshotsTestJSON-920806094 Apr 12 00:48:28 user devstack@n-api.service[72495]: X-Tenant-Id: 3a8683cf83d0436ab247fb4c72bf206b Apr 12 00:48:28 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-920806094 Apr 12 00:48:28 user devstack@n-api.service[72495]: X-User: tempest-VolumesSnapshotsTestJSON-920806094-project-member Apr 12 00:48:28 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:48:28 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:48:28 user devstack@n-api.service[72495]: X-User-Id: 18843a1e6f954fc897091fa9f02914a4 Apr 12 00:48:28 user devstack@n-api.service[72495]: X-User-Name: tempest-VolumesSnapshotsTestJSON-920806094-project-member Apr 12 00:48:28 user devstack@n-api.service[72495]: method: Apr 12 00:48:28 user devstack@n-api.service[72495]: exception: Volume 8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e could not be found. Apr 12 00:48:28 user devstack@n-api.service[72495]: action_args: {'id': '8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e'} Apr 12 00:48:28 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e could not be found. (HTTP 404) (Request-ID: req-eb26ffef-415a-4c9f-b2d8-9e9fcceeef05) Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e could not be found. Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e could not be found. Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e could not be found. Apr 12 00:48:28 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:48:28 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-6c333db6-8100-4632-8f86-d491d610282a tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] Returning 404 to user: Volume 8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:48:28 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-6c333db6-8100-4632-8f86-d491d610282a tempest-VolumesSnapshotsTestJSON-920806094 tempest-VolumesSnapshotsTestJSON-920806094-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e" status: 404 len: 109 microversion: 2.1 time: 0.038498 Apr 12 00:48:28 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 286/865] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 00:48:28 2023] GET /compute/v2.1/os-volumes/8bc9ccd4-6486-4d93-b2d1-6c7b7c3ef23e => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:48:29 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-c4fd6de9-902a-4e50-b87b-ea9daea5e1b8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:29 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-c4fd6de9-902a-4e50-b87b-ea9daea5e1b8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c4fd6de9-902a-4e50-b87b-ea9daea5e1b8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c4fd6de9-902a-4e50-b87b-ea9daea5e1b8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c4fd6de9-902a-4e50-b87b-ea9daea5e1b8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c4fd6de9-902a-4e50-b87b-ea9daea5e1b8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c4fd6de9-902a-4e50-b87b-ea9daea5e1b8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c4fd6de9-902a-4e50-b87b-ea9daea5e1b8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:29 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=14 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:48:29 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-9a01cd59-c9fa-403a-a7ee-44adc739076e tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:29 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-9a01cd59-c9fa-403a-a7ee-44adc739076e tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:29 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-c4fd6de9-902a-4e50-b87b-ea9daea5e1b8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842535891eb4a9880f7e8859dd0de3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66fda80cb83402392e155c76ee78e1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:48:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9a01cd59-c9fa-403a-a7ee-44adc739076e tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9a01cd59-c9fa-403a-a7ee-44adc739076e tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9a01cd59-c9fa-403a-a7ee-44adc739076e tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9a01cd59-c9fa-403a-a7ee-44adc739076e tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9a01cd59-c9fa-403a-a7ee-44adc739076e tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9a01cd59-c9fa-403a-a7ee-44adc739076e tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:29 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-c4fd6de9-902a-4e50-b87b-ea9daea5e1b8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90" status: 200 len: 1580 microversion: 2.1 time: 0.162078 Apr 12 00:48:29 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 290/866] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:48:29 2023] GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90 => generated 1580 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:48:29 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-9a01cd59-c9fa-403a-a7ee-44adc739076e tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:48:29 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-9a01cd59-c9fa-403a-a7ee-44adc739076e tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:48:29 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-9a01cd59-c9fa-403a-a7ee-44adc739076e tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:48:29 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-9a01cd59-c9fa-403a-a7ee-44adc739076e tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580" status: 200 len: 1587 microversion: 2.20 time: 0.275628 Apr 12 00:48:29 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 291/867] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:48:29 2023] GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580 => generated 1587 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:48:31 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:48:31 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-4e8364e8-36a1-4711-b0f3-260077f4b3b4 req-3add2382-171f-44e8-8e67-6c0df8688caa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fdb2b97-85b9-4e15-b586-948c3804da90", "tag": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:48:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-4e8364e8-36a1-4711-b0f3-260077f4b3b4 req-3add2382-171f-44e8-8e67-6c0df8688caa service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-4e8364e8-36a1-4711-b0f3-260077f4b3b4 req-3add2382-171f-44e8-8e67-6c0df8688caa service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-4e8364e8-36a1-4711-b0f3-260077f4b3b4 req-3add2382-171f-44e8-8e67-6c0df8688caa service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:31 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-4e8364e8-36a1-4711-b0f3-260077f4b3b4 req-3add2382-171f-44e8-8e67-6c0df8688caa service nova] Creating event network-changed:b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance 1fdb2b97-85b9-4e15-b586-948c3804da90 on user Apr 12 00:48:31 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-4e8364e8-36a1-4711-b0f3-260077f4b3b4 req-3add2382-171f-44e8-8e67-6c0df8688caa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040208 Apr 12 00:48:31 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 287/868] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:48:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:32 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-a8946a02-8308-4239-8ee0-b3a2aa8444ba tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-984426262"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:48:32 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-a8946a02-8308-4239-8ee0-b3a2aa8444ba tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:32 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a8946a02-8308-4239-8ee0-b3a2aa8444ba tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:32 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a8946a02-8308-4239-8ee0-b3a2aa8444ba tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:32 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a8946a02-8308-4239-8ee0-b3a2aa8444ba tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:32 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a8946a02-8308-4239-8ee0-b3a2aa8444ba tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:32 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a8946a02-8308-4239-8ee0-b3a2aa8444ba tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:32 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a8946a02-8308-4239-8ee0-b3a2aa8444ba tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:32 user devstack@n-api.service[72494]: INFO nova.network.security_group_api [None req-a8946a02-8308-4239-8ee0-b3a2aa8444ba tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Adding security group 24fbb704-56cd-4e5d-b670-5e79cbb44e40 to port b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 Apr 12 00:48:32 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-a8946a02-8308-4239-8ee0-b3a2aa8444ba tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90/action" status: 202 len: 0 microversion: 2.1 time: 0.581378 Apr 12 00:48:32 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 291/869] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 00:48:32 2023] POST /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90/action => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:48:32 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-94b85f0c-eaf1-4c95-a840-59407461905e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:32 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-94b85f0c-eaf1-4c95-a840-59407461905e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:32 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-fea1836b-d6b2-4342-94d4-a27a6f432f71 req-195d344d-663e-4f05-bf02-830e38477eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fdb2b97-85b9-4e15-b586-948c3804da90", "tag": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:48:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-94b85f0c-eaf1-4c95-a840-59407461905e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-94b85f0c-eaf1-4c95-a840-59407461905e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-94b85f0c-eaf1-4c95-a840-59407461905e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-94b85f0c-eaf1-4c95-a840-59407461905e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-94b85f0c-eaf1-4c95-a840-59407461905e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:32 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-94b85f0c-eaf1-4c95-a840-59407461905e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:32 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-fea1836b-d6b2-4342-94d4-a27a6f432f71 req-195d344d-663e-4f05-bf02-830e38477eb3 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:32 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-fea1836b-d6b2-4342-94d4-a27a6f432f71 req-195d344d-663e-4f05-bf02-830e38477eb3 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:32 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-fea1836b-d6b2-4342-94d4-a27a6f432f71 req-195d344d-663e-4f05-bf02-830e38477eb3 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:33 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-94b85f0c-eaf1-4c95-a840-59407461905e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842535891eb4a9880f7e8859dd0de3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66fda80cb83402392e155c76ee78e1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:48:33 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-94b85f0c-eaf1-4c95-a840-59407461905e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90" status: 200 len: 1745 microversion: 2.1 time: 0.169957 Apr 12 00:48:33 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 288/870] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:48:32 2023] GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90 => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:48:33 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-5875f7d7-c45a-4738-a1a4-440d82070258 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:48:33 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-5875f7d7-c45a-4738-a1a4-440d82070258 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5875f7d7-c45a-4738-a1a4-440d82070258 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5875f7d7-c45a-4738-a1a4-440d82070258 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5875f7d7-c45a-4738-a1a4-440d82070258 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5875f7d7-c45a-4738-a1a4-440d82070258 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5875f7d7-c45a-4738-a1a4-440d82070258 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5875f7d7-c45a-4738-a1a4-440d82070258 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:33 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-fea1836b-d6b2-4342-94d4-a27a6f432f71 req-195d344d-663e-4f05-bf02-830e38477eb3 service nova] Creating event network-changed:b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance 1fdb2b97-85b9-4e15-b586-948c3804da90 on user Apr 12 00:48:33 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-fea1836b-d6b2-4342-94d4-a27a6f432f71 req-195d344d-663e-4f05-bf02-830e38477eb3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.327584 Apr 12 00:48:33 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 292/871] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:48:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:33 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-5875f7d7-c45a-4738-a1a4-440d82070258 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90/action" status: 202 len: 0 microversion: 2.1 time: 0.113643 Apr 12 00:48:33 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 292/872] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 00:48:33 2023] POST /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:48:33 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-714e783d-f300-48f3-bd86-18b46d09133b tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:33 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-714e783d-f300-48f3-bd86-18b46d09133b tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-714e783d-f300-48f3-bd86-18b46d09133b tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-714e783d-f300-48f3-bd86-18b46d09133b tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-714e783d-f300-48f3-bd86-18b46d09133b tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-714e783d-f300-48f3-bd86-18b46d09133b tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-714e783d-f300-48f3-bd86-18b46d09133b tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-714e783d-f300-48f3-bd86-18b46d09133b tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:33 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-714e783d-f300-48f3-bd86-18b46d09133b tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842535891eb4a9880f7e8859dd0de3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66fda80cb83402392e155c76ee78e1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:48:33 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-714e783d-f300-48f3-bd86-18b46d09133b tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90" status: 200 len: 1737 microversion: 2.1 time: 0.176033 Apr 12 00:48:33 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 289/873] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:48:33 2023] GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:48:36 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-af773bf7-eacf-40e0-b578-f99babf52b97 req-48f751e1-275c-470b-b9c2-8a463ade4ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fdb2b97-85b9-4e15-b586-948c3804da90", "name": "network-vif-unplugged", "status": "completed", "tag": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:48:36 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-af773bf7-eacf-40e0-b578-f99babf52b97 req-48f751e1-275c-470b-b9c2-8a463ade4ee5 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:36 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-af773bf7-eacf-40e0-b578-f99babf52b97 req-48f751e1-275c-470b-b9c2-8a463ade4ee5 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:36 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-af773bf7-eacf-40e0-b578-f99babf52b97 req-48f751e1-275c-470b-b9c2-8a463ade4ee5 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:36 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=35 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:48:36 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-af773bf7-eacf-40e0-b578-f99babf52b97 req-48f751e1-275c-470b-b9c2-8a463ade4ee5 service nova] Creating event network-vif-unplugged:b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance 1fdb2b97-85b9-4e15-b586-948c3804da90 on user Apr 12 00:48:36 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-af773bf7-eacf-40e0-b578-f99babf52b97 req-48f751e1-275c-470b-b9c2-8a463ade4ee5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029884 Apr 12 00:48:36 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 293/874] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:48:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:38 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-b58a4aa1-8139-425d-8f5f-949531abd8c7 req-57092331-0d06-426d-8add-b4e7a31fa37b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fdb2b97-85b9-4e15-b586-948c3804da90", "name": "network-vif-plugged", "status": "completed", "tag": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:48:38 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=37 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:48:38 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-b58a4aa1-8139-425d-8f5f-949531abd8c7 req-57092331-0d06-426d-8add-b4e7a31fa37b service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:38 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-b58a4aa1-8139-425d-8f5f-949531abd8c7 req-57092331-0d06-426d-8add-b4e7a31fa37b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:38 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-b58a4aa1-8139-425d-8f5f-949531abd8c7 req-57092331-0d06-426d-8add-b4e7a31fa37b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:38 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:48:38 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-b58a4aa1-8139-425d-8f5f-949531abd8c7 req-57092331-0d06-426d-8add-b4e7a31fa37b service nova] Creating event network-vif-plugged:b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance 1fdb2b97-85b9-4e15-b586-948c3804da90 on user Apr 12 00:48:38 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-b58a4aa1-8139-425d-8f5f-949531abd8c7 req-57092331-0d06-426d-8add-b4e7a31fa37b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037534 Apr 12 00:48:38 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 293/875] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:48:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:40 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-f19a6085-645f-4c2b-a3e0-dd8b31598a53 req-e9d2173d-0ed8-42d1-987a-3024c79138c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fdb2b97-85b9-4e15-b586-948c3804da90", "name": "network-vif-plugged", "status": "completed", "tag": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7"}, {"server_uuid": "1fdb2b97-85b9-4e15-b586-948c3804da90", "name": "network-vif-plugged", "status": "completed", "tag": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:48:40 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:48:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-f19a6085-645f-4c2b-a3e0-dd8b31598a53 req-e9d2173d-0ed8-42d1-987a-3024c79138c8 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-f19a6085-645f-4c2b-a3e0-dd8b31598a53 req-e9d2173d-0ed8-42d1-987a-3024c79138c8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-f19a6085-645f-4c2b-a3e0-dd8b31598a53 req-e9d2173d-0ed8-42d1-987a-3024c79138c8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:40 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:48:40 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-f19a6085-645f-4c2b-a3e0-dd8b31598a53 req-e9d2173d-0ed8-42d1-987a-3024c79138c8 service nova] Creating event network-vif-plugged:b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance 1fdb2b97-85b9-4e15-b586-948c3804da90 on user Apr 12 00:48:40 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-f19a6085-645f-4c2b-a3e0-dd8b31598a53 req-e9d2173d-0ed8-42d1-987a-3024c79138c8 service nova] Creating event network-vif-plugged:b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance 1fdb2b97-85b9-4e15-b586-948c3804da90 on user Apr 12 00:48:40 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-f19a6085-645f-4c2b-a3e0-dd8b31598a53 req-e9d2173d-0ed8-42d1-987a-3024c79138c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050807 Apr 12 00:48:40 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 290/876] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:48:40 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:52 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:48:52 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:48:52 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-e1bb51e8-7769-4eea-8f6c-e4a90ba5a5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:48:52 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-e1bb51e8-7769-4eea-8f6c-e4a90ba5a5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:52 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-e1bb51e8-7769-4eea-8f6c-e4a90ba5a5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:52 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-e1bb51e8-7769-4eea-8f6c-e4a90ba5a5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:52 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-e1bb51e8-7769-4eea-8f6c-e4a90ba5a5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:52 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-e1bb51e8-7769-4eea-8f6c-e4a90ba5a5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:52 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-e1bb51e8-7769-4eea-8f6c-e4a90ba5a5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:52 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-e1bb51e8-7769-4eea-8f6c-e4a90ba5a5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:52 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-e1bb51e8-7769-4eea-8f6c-e4a90ba5a5da tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b0c7ca20-c237-43b0-9a75-2a21392c7fd0/action" status: 202 len: 0 microversion: 2.87 time: 0.079738 Apr 12 00:48:52 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 294/877] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 00:48:52 2023] POST /compute/v2.1/servers/b0c7ca20-c237-43b0-9a75-2a21392c7fd0/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:48:52 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:48:52 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-092cb3b0-670e-4634-a8d9-cacc99dbbdb4 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:52 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-092cb3b0-670e-4634-a8d9-cacc99dbbdb4 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-092cb3b0-670e-4634-a8d9-cacc99dbbdb4 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-092cb3b0-670e-4634-a8d9-cacc99dbbdb4 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-092cb3b0-670e-4634-a8d9-cacc99dbbdb4 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-092cb3b0-670e-4634-a8d9-cacc99dbbdb4 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-092cb3b0-670e-4634-a8d9-cacc99dbbdb4 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:52 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-092cb3b0-670e-4634-a8d9-cacc99dbbdb4 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:52 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-092cb3b0-670e-4634-a8d9-cacc99dbbdb4 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:48:52 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-092cb3b0-670e-4634-a8d9-cacc99dbbdb4 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:48:52 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-092cb3b0-670e-4634-a8d9-cacc99dbbdb4 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:48:52 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-092cb3b0-670e-4634-a8d9-cacc99dbbdb4 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0c7ca20-c237-43b0-9a75-2a21392c7fd0" status: 200 len: 1763 microversion: 2.87 time: 0.177112 Apr 12 00:48:52 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 294/878] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:48:52 2023] GET /compute/v2.1/servers/b0c7ca20-c237-43b0-9a75-2a21392c7fd0 => generated 1763 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:48:53 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-dbd007d3-6620-4d6e-bff6-ba2043169cc4 req-78425d07-e6c2-42c8-9824-7b7c3fbb0e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c7ca20-c237-43b0-9a75-2a21392c7fd0", "name": "network-vif-unplugged", "status": "completed", "tag": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:48:53 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:48:53 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-dbd007d3-6620-4d6e-bff6-ba2043169cc4 req-78425d07-e6c2-42c8-9824-7b7c3fbb0e32 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:53 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-dbd007d3-6620-4d6e-bff6-ba2043169cc4 req-78425d07-e6c2-42c8-9824-7b7c3fbb0e32 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:53 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-dbd007d3-6620-4d6e-bff6-ba2043169cc4 req-78425d07-e6c2-42c8-9824-7b7c3fbb0e32 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:53 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-dbd007d3-6620-4d6e-bff6-ba2043169cc4 req-78425d07-e6c2-42c8-9824-7b7c3fbb0e32 service nova] Creating event network-vif-unplugged:2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 on user Apr 12 00:48:53 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-dbd007d3-6620-4d6e-bff6-ba2043169cc4 req-78425d07-e6c2-42c8-9824-7b7c3fbb0e32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035634 Apr 12 00:48:53 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 291/879] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:48:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:55 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-ea46aa11-6251-4246-bc60-98fb2be6fa5c req-4c84c23b-3ed9-4246-8493-3fcfc309dcb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c7ca20-c237-43b0-9a75-2a21392c7fd0", "name": "network-vif-plugged", "status": "completed", "tag": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf"}, {"server_uuid": "b0c7ca20-c237-43b0-9a75-2a21392c7fd0", "name": "network-vif-plugged", "status": "completed", "tag": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:48:55 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-ea46aa11-6251-4246-bc60-98fb2be6fa5c req-4c84c23b-3ed9-4246-8493-3fcfc309dcb6 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:55 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-ea46aa11-6251-4246-bc60-98fb2be6fa5c req-4c84c23b-3ed9-4246-8493-3fcfc309dcb6 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:55 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-ea46aa11-6251-4246-bc60-98fb2be6fa5c req-4c84c23b-3ed9-4246-8493-3fcfc309dcb6 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:55 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-ea46aa11-6251-4246-bc60-98fb2be6fa5c req-4c84c23b-3ed9-4246-8493-3fcfc309dcb6 service nova] Creating event network-vif-plugged:2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 on user Apr 12 00:48:55 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-ea46aa11-6251-4246-bc60-98fb2be6fa5c req-4c84c23b-3ed9-4246-8493-3fcfc309dcb6 service nova] Creating event network-vif-plugged:2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 on user Apr 12 00:48:55 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-ea46aa11-6251-4246-bc60-98fb2be6fa5c req-4c84c23b-3ed9-4246-8493-3fcfc309dcb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045418 Apr 12 00:48:55 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 295/880] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:48:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:48:56 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-bb9599c6-6e53-4b03-8318-dd137ee361ea tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:48:56 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-bb9599c6-6e53-4b03-8318-dd137ee361ea tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:48:56 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-bb9599c6-6e53-4b03-8318-dd137ee361ea tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:56 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-bb9599c6-6e53-4b03-8318-dd137ee361ea tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:56 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-bb9599c6-6e53-4b03-8318-dd137ee361ea tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:56 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-bb9599c6-6e53-4b03-8318-dd137ee361ea tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:56 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-bb9599c6-6e53-4b03-8318-dd137ee361ea tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:56 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-bb9599c6-6e53-4b03-8318-dd137ee361ea tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:56 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-bb9599c6-6e53-4b03-8318-dd137ee361ea tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:48:56 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-bb9599c6-6e53-4b03-8318-dd137ee361ea tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749" status: 200 len: 1554 microversion: 2.1 time: 0.168975 Apr 12 00:48:56 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 295/881] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:48:56 2023] GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:48:57 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-eec30f3c-46e4-4792-ad88-ba268ea77995 req-0186f00d-093d-4de6-9a1d-e21befd2ac76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c7ca20-c237-43b0-9a75-2a21392c7fd0", "name": "network-vif-plugged", "status": "completed", "tag": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:48:57 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-eec30f3c-46e4-4792-ad88-ba268ea77995 req-0186f00d-093d-4de6-9a1d-e21befd2ac76 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:48:57 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-eec30f3c-46e4-4792-ad88-ba268ea77995 req-0186f00d-093d-4de6-9a1d-e21befd2ac76 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:48:57 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-eec30f3c-46e4-4792-ad88-ba268ea77995 req-0186f00d-093d-4de6-9a1d-e21befd2ac76 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:48:57 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-eec30f3c-46e4-4792-ad88-ba268ea77995 req-0186f00d-093d-4de6-9a1d-e21befd2ac76 service nova] Creating event network-vif-plugged:2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 on user Apr 12 00:48:57 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-eec30f3c-46e4-4792-ad88-ba268ea77995 req-0186f00d-093d-4de6-9a1d-e21befd2ac76 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031550 Apr 12 00:48:57 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 292/882] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:48:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:49:23 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:49:23 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:49:23 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-c9d39846-2bb4-4ff8-939f-a8b26d2572d8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:49:23 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-c9d39846-2bb4-4ff8-939f-a8b26d2572d8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:49:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c9d39846-2bb4-4ff8-939f-a8b26d2572d8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:49:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c9d39846-2bb4-4ff8-939f-a8b26d2572d8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:49:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c9d39846-2bb4-4ff8-939f-a8b26d2572d8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:49:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c9d39846-2bb4-4ff8-939f-a8b26d2572d8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:49:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c9d39846-2bb4-4ff8-939f-a8b26d2572d8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:49:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c9d39846-2bb4-4ff8-939f-a8b26d2572d8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:49:23 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-c9d39846-2bb4-4ff8-939f-a8b26d2572d8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842535891eb4a9880f7e8859dd0de3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66fda80cb83402392e155c76ee78e1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:49:23 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-c9d39846-2bb4-4ff8-939f-a8b26d2572d8 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90" status: 200 len: 1745 microversion: 2.1 time: 0.238504 Apr 12 00:49:23 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 296/883] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:49:23 2023] GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90 => generated 1745 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:49:29 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-3599e57d-49bb-4454-8a9e-0cc7065476e9 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:49:29 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-3599e57d-49bb-4454-8a9e-0cc7065476e9 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:49:29 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=6 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:49:29 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=13 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:49:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3599e57d-49bb-4454-8a9e-0cc7065476e9 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:49:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3599e57d-49bb-4454-8a9e-0cc7065476e9 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:49:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3599e57d-49bb-4454-8a9e-0cc7065476e9 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:49:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3599e57d-49bb-4454-8a9e-0cc7065476e9 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:49:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3599e57d-49bb-4454-8a9e-0cc7065476e9 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:49:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3599e57d-49bb-4454-8a9e-0cc7065476e9 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:49:29 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-3599e57d-49bb-4454-8a9e-0cc7065476e9 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.110752 Apr 12 00:49:29 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 296/884] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 00:49:29 2023] GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580/os-interface => generated 282 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:49:30 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:49:30 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=5 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:49:30 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-d8e32971-369a-402c-9714-9e6625484afa req-6ab24b58-2745-4e4c-b7a4-af075a7e38da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d163ed-7900-486c-8b96-101af5547580", "tag": "f10369c7-25e6-4570-86a1-5e9ec3e941be"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:49:30 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d8e32971-369a-402c-9714-9e6625484afa req-6ab24b58-2745-4e4c-b7a4-af075a7e38da service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:49:30 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d8e32971-369a-402c-9714-9e6625484afa req-6ab24b58-2745-4e4c-b7a4-af075a7e38da service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:49:30 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d8e32971-369a-402c-9714-9e6625484afa req-6ab24b58-2745-4e4c-b7a4-af075a7e38da service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:49:30 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-b841b292-9de4-4c5a-a26f-0a8874cf11b5 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:49:30 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-b841b292-9de4-4c5a-a26f-0a8874cf11b5 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:49:30 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b841b292-9de4-4c5a-a26f-0a8874cf11b5 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:49:30 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b841b292-9de4-4c5a-a26f-0a8874cf11b5 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:49:30 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b841b292-9de4-4c5a-a26f-0a8874cf11b5 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:49:30 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b841b292-9de4-4c5a-a26f-0a8874cf11b5 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:49:30 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b841b292-9de4-4c5a-a26f-0a8874cf11b5 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:49:30 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b841b292-9de4-4c5a-a26f-0a8874cf11b5 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:49:30 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-d8e32971-369a-402c-9714-9e6625484afa req-6ab24b58-2745-4e4c-b7a4-af075a7e38da service nova] Creating event network-changed:f10369c7-25e6-4570-86a1-5e9ec3e941be for instance a4d163ed-7900-486c-8b96-101af5547580 on user Apr 12 00:49:30 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-d8e32971-369a-402c-9714-9e6625484afa req-6ab24b58-2745-4e4c-b7a4-af075a7e38da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082738 Apr 12 00:49:30 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 293/885] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:49:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:49:30 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-b841b292-9de4-4c5a-a26f-0a8874cf11b5 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580/ips" status: 200 len: 110 microversion: 2.20 time: 0.038030 Apr 12 00:49:30 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 297/886] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 12 00:49:30 2023] GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580/ips => generated 110 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:49:32 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:49:32 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:49:32 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:49:32 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:49:32 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:49:32 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:49:32 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:49:32 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:49:32 user devstack@n-api.service[72494]: DEBUG nova.objects.instance [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'flavor' on Instance uuid a4d163ed-7900-486c-8b96-101af5547580 {{(pid=72494) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:49:33 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-4de32911-1e08-4713-b8e7-337a27d30952 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580/action" status: 202 len: 0 microversion: 2.20 time: 0.838043 Apr 12 00:49:33 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 297/887] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 00:49:32 2023] POST /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580/action => generated 0 bytes in 839 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:49:33 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-5b864280-7364-4cda-8504-f1e5992f0751 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:49:33 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-5b864280-7364-4cda-8504-f1e5992f0751 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:49:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5b864280-7364-4cda-8504-f1e5992f0751 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:49:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5b864280-7364-4cda-8504-f1e5992f0751 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:49:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5b864280-7364-4cda-8504-f1e5992f0751 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:49:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5b864280-7364-4cda-8504-f1e5992f0751 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:49:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5b864280-7364-4cda-8504-f1e5992f0751 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:49:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-5b864280-7364-4cda-8504-f1e5992f0751 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:49:33 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-5b864280-7364-4cda-8504-f1e5992f0751 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:49:33 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-5b864280-7364-4cda-8504-f1e5992f0751 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:49:33 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-5b864280-7364-4cda-8504-f1e5992f0751 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:49:33 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-5b864280-7364-4cda-8504-f1e5992f0751 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580" status: 200 len: 1712 microversion: 2.20 time: 0.277926 Apr 12 00:49:33 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 294/888] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:49:33 2023] GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580 => generated 1712 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:49:33 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-4cc057f6-0da2-4ecd-93e8-cb6a1b74edd0 req-1d7e90a4-ca48-4224-bcb6-3042cbe22812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d163ed-7900-486c-8b96-101af5547580", "name": "network-vif-unplugged", "status": "completed", "tag": "f10369c7-25e6-4570-86a1-5e9ec3e941be"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:49:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4cc057f6-0da2-4ecd-93e8-cb6a1b74edd0 req-1d7e90a4-ca48-4224-bcb6-3042cbe22812 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:49:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4cc057f6-0da2-4ecd-93e8-cb6a1b74edd0 req-1d7e90a4-ca48-4224-bcb6-3042cbe22812 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:49:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4cc057f6-0da2-4ecd-93e8-cb6a1b74edd0 req-1d7e90a4-ca48-4224-bcb6-3042cbe22812 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:49:33 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-4cc057f6-0da2-4ecd-93e8-cb6a1b74edd0 req-1d7e90a4-ca48-4224-bcb6-3042cbe22812 service nova] Creating event network-vif-unplugged:f10369c7-25e6-4570-86a1-5e9ec3e941be for instance a4d163ed-7900-486c-8b96-101af5547580 on user Apr 12 00:49:33 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-4cc057f6-0da2-4ecd-93e8-cb6a1b74edd0 req-1d7e90a4-ca48-4224-bcb6-3042cbe22812 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032718 Apr 12 00:49:33 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 298/889] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:49:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:49:35 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-7d5af2e2-ac47-4350-bf9b-49848dc5eaaa req-ca56511e-334d-41e6-bd27-85c47d7afa14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d163ed-7900-486c-8b96-101af5547580", "name": "network-vif-plugged", "status": "completed", "tag": "f10369c7-25e6-4570-86a1-5e9ec3e941be"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:49:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-7d5af2e2-ac47-4350-bf9b-49848dc5eaaa req-ca56511e-334d-41e6-bd27-85c47d7afa14 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:49:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-7d5af2e2-ac47-4350-bf9b-49848dc5eaaa req-ca56511e-334d-41e6-bd27-85c47d7afa14 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:49:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-7d5af2e2-ac47-4350-bf9b-49848dc5eaaa req-ca56511e-334d-41e6-bd27-85c47d7afa14 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:49:35 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-7d5af2e2-ac47-4350-bf9b-49848dc5eaaa req-ca56511e-334d-41e6-bd27-85c47d7afa14 service nova] Creating event network-vif-plugged:f10369c7-25e6-4570-86a1-5e9ec3e941be for instance a4d163ed-7900-486c-8b96-101af5547580 on user Apr 12 00:49:35 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-7d5af2e2-ac47-4350-bf9b-49848dc5eaaa req-ca56511e-334d-41e6-bd27-85c47d7afa14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028934 Apr 12 00:49:35 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 298/890] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:49:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:49:37 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-c1e0058b-b0f2-49cb-b651-cabd9d019a50 req-c4541626-7841-45bb-8a58-96777aace754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d163ed-7900-486c-8b96-101af5547580", "tag": "f10369c7-25e6-4570-86a1-5e9ec3e941be"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:49:37 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-c1e0058b-b0f2-49cb-b651-cabd9d019a50 req-c4541626-7841-45bb-8a58-96777aace754 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:49:37 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-c1e0058b-b0f2-49cb-b651-cabd9d019a50 req-c4541626-7841-45bb-8a58-96777aace754 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:49:37 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-c1e0058b-b0f2-49cb-b651-cabd9d019a50 req-c4541626-7841-45bb-8a58-96777aace754 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:49:37 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-c1e0058b-b0f2-49cb-b651-cabd9d019a50 req-c4541626-7841-45bb-8a58-96777aace754 service nova] Creating event network-changed:f10369c7-25e6-4570-86a1-5e9ec3e941be for instance a4d163ed-7900-486c-8b96-101af5547580 on user Apr 12 00:49:37 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-c1e0058b-b0f2-49cb-b651-cabd9d019a50 req-c4541626-7841-45bb-8a58-96777aace754 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029852 Apr 12 00:49:37 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 295/891] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:49:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:49:42 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-0ca33c06-3498-4842-8846-daaf50ba08ca tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:49:42 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-0ca33c06-3498-4842-8846-daaf50ba08ca tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:49:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0ca33c06-3498-4842-8846-daaf50ba08ca tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:49:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0ca33c06-3498-4842-8846-daaf50ba08ca tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:49:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0ca33c06-3498-4842-8846-daaf50ba08ca tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:49:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0ca33c06-3498-4842-8846-daaf50ba08ca tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:49:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0ca33c06-3498-4842-8846-daaf50ba08ca tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:49:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0ca33c06-3498-4842-8846-daaf50ba08ca tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:49:42 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-0ca33c06-3498-4842-8846-daaf50ba08ca tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:49:42 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-0ca33c06-3498-4842-8846-daaf50ba08ca tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:49:42 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-0ca33c06-3498-4842-8846-daaf50ba08ca tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:49:42 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-0ca33c06-3498-4842-8846-daaf50ba08ca tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0c7ca20-c237-43b0-9a75-2a21392c7fd0" status: 200 len: 1769 microversion: 2.87 time: 0.167449 Apr 12 00:49:42 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 299/892] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:49:42 2023] GET /compute/v2.1/servers/b0c7ca20-c237-43b0-9a75-2a21392c7fd0 => generated 1769 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:49:56 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=6 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:49:56 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:49:56 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:49:56 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:49:56 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:49:56 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:49:56 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:49:56 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:49:56 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:49:56 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:49:56 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-bd1b41b4-5bf1-4a6d-a2ae-1c09bbe38e41 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749/action" status: 204 len: 0 microversion: 2.1 time: 0.071366 Apr 12 00:49:56 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 299/893] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 00:49:56 2023] POST /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:49:56 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:49:56 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=10 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:49:56 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-dac9cfbf-56b0-417d-9115-92d7e0990a6a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:49:56 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-dac9cfbf-56b0-417d-9115-92d7e0990a6a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:49:56 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dac9cfbf-56b0-417d-9115-92d7e0990a6a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:49:56 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dac9cfbf-56b0-417d-9115-92d7e0990a6a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:49:56 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dac9cfbf-56b0-417d-9115-92d7e0990a6a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:49:56 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dac9cfbf-56b0-417d-9115-92d7e0990a6a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:49:56 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dac9cfbf-56b0-417d-9115-92d7e0990a6a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:49:56 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dac9cfbf-56b0-417d-9115-92d7e0990a6a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:49:57 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-dac9cfbf-56b0-417d-9115-92d7e0990a6a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:49:57 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-dac9cfbf-56b0-417d-9115-92d7e0990a6a tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749" status: 200 len: 1554 microversion: 2.1 time: 0.459623 Apr 12 00:49:57 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 296/894] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:49:56 2023] GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749 => generated 1554 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:50:23 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=18 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:50:23 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=10 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:50:23 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-f29a7a80-8943-4afc-bc93-51912c5ea173 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:50:23 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-f29a7a80-8943-4afc-bc93-51912c5ea173 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:50:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f29a7a80-8943-4afc-bc93-51912c5ea173 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:50:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f29a7a80-8943-4afc-bc93-51912c5ea173 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:50:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f29a7a80-8943-4afc-bc93-51912c5ea173 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:50:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f29a7a80-8943-4afc-bc93-51912c5ea173 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:50:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f29a7a80-8943-4afc-bc93-51912c5ea173 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:50:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-f29a7a80-8943-4afc-bc93-51912c5ea173 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:50:23 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:50:23 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:50:23 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-f29a7a80-8943-4afc-bc93-51912c5ea173 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:50:23 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-3f2124cc-952a-4480-a158-7b1f50176a1f tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-984426262"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:50:23 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-3f2124cc-952a-4480-a158-7b1f50176a1f tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:50:23 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-f29a7a80-8943-4afc-bc93-51912c5ea173 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:50:23 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-f29a7a80-8943-4afc-bc93-51912c5ea173 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:50:23 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-f29a7a80-8943-4afc-bc93-51912c5ea173 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580" status: 200 len: 1653 microversion: 2.20 time: 0.458497 Apr 12 00:50:23 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 300/895] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:50:23 2023] GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580 => generated 1653 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:50:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3f2124cc-952a-4480-a158-7b1f50176a1f tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:50:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3f2124cc-952a-4480-a158-7b1f50176a1f tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:50:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3f2124cc-952a-4480-a158-7b1f50176a1f tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:50:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3f2124cc-952a-4480-a158-7b1f50176a1f tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:50:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3f2124cc-952a-4480-a158-7b1f50176a1f tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:50:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3f2124cc-952a-4480-a158-7b1f50176a1f tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:50:24 user devstack@n-api.service[72494]: INFO nova.network.security_group_api [None req-3f2124cc-952a-4480-a158-7b1f50176a1f tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Removing security group 24fbb704-56cd-4e5d-b670-5e79cbb44e40 from port b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 Apr 12 00:50:24 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-3f2124cc-952a-4480-a158-7b1f50176a1f tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90/action" status: 202 len: 0 microversion: 2.1 time: 0.723104 Apr 12 00:50:24 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 300/896] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 00:50:23 2023] POST /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90/action => generated 0 bytes in 725 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:50:24 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-83c57719-82fa-4f6e-b5ff-2db428173d9c req-53aa6d11-becb-4c9d-8a10-4e4782faeb17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fdb2b97-85b9-4e15-b586-948c3804da90", "tag": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:50:24 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:50:24 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:50:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-83c57719-82fa-4f6e-b5ff-2db428173d9c req-53aa6d11-becb-4c9d-8a10-4e4782faeb17 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:50:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-83c57719-82fa-4f6e-b5ff-2db428173d9c req-53aa6d11-becb-4c9d-8a10-4e4782faeb17 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:50:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-83c57719-82fa-4f6e-b5ff-2db428173d9c req-53aa6d11-becb-4c9d-8a10-4e4782faeb17 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:50:24 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-83c57719-82fa-4f6e-b5ff-2db428173d9c req-53aa6d11-becb-4c9d-8a10-4e4782faeb17 service nova] Creating event network-changed:b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance 1fdb2b97-85b9-4e15-b586-948c3804da90 on user Apr 12 00:50:24 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-83c57719-82fa-4f6e-b5ff-2db428173d9c req-53aa6d11-becb-4c9d-8a10-4e4782faeb17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037554 Apr 12 00:50:24 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 297/897] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:50:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:50:25 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:50:25 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:50:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:50:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:50:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:50:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:50:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:50:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:50:25 user devstack@n-api.service[72496]: DEBUG nova.objects.instance [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lazy-loading 'services' on Instance uuid 1fdb2b97-85b9-4e15-b586-948c3804da90 {{(pid=72496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:50:25 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-affd48fd-677a-4646-8257-4d72b4e4baec tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90/os-volume_attachments/35254bb1-a5b6-4517-96c9-7d1df42532a5" status: 202 len: 0 microversion: 2.1 time: 0.224599 Apr 12 00:50:25 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 301/898] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 00:50:25 2023] DELETE /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90/os-volume_attachments/35254bb1-a5b6-4517-96c9-7d1df42532a5 => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:50:25 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-867793ab-6e51-40da-852f-de9efd98b450 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:50:25 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-867793ab-6e51-40da-852f-de9efd98b450 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:50:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-867793ab-6e51-40da-852f-de9efd98b450 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:50:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-867793ab-6e51-40da-852f-de9efd98b450 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:50:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-867793ab-6e51-40da-852f-de9efd98b450 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:50:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-867793ab-6e51-40da-852f-de9efd98b450 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:50:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-867793ab-6e51-40da-852f-de9efd98b450 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:50:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-867793ab-6e51-40da-852f-de9efd98b450 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:50:25 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-867793ab-6e51-40da-852f-de9efd98b450 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049128 Apr 12 00:50:25 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 301/899] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:50:25 2023] GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:50:26 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-863eeff8-efe2-44a7-a404-4075d0f06f1a req-a588b252-6ba6-417f-a1cb-a69342562442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fdb2b97-85b9-4e15-b586-948c3804da90", "tag": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:50:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-863eeff8-efe2-44a7-a404-4075d0f06f1a req-a588b252-6ba6-417f-a1cb-a69342562442 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:50:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-863eeff8-efe2-44a7-a404-4075d0f06f1a req-a588b252-6ba6-417f-a1cb-a69342562442 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:50:26 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-863eeff8-efe2-44a7-a404-4075d0f06f1a req-a588b252-6ba6-417f-a1cb-a69342562442 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:50:26 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-863eeff8-efe2-44a7-a404-4075d0f06f1a req-a588b252-6ba6-417f-a1cb-a69342562442 service nova] Creating event network-changed:b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance 1fdb2b97-85b9-4e15-b586-948c3804da90 on user Apr 12 00:50:26 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-863eeff8-efe2-44a7-a404-4075d0f06f1a req-a588b252-6ba6-417f-a1cb-a69342562442 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031294 Apr 12 00:50:26 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 298/900] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:50:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:50:42 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:50:42 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:50:42 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:50:42 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:50:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:50:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:50:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:50:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:50:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:50:42 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:50:42 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Going to try to terminate instance {{(pid=72496) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:50:42 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-00f53b39-e12e-4f21-9e74-0ed8d3bbcbe9 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b0c7ca20-c237-43b0-9a75-2a21392c7fd0" status: 204 len: 0 microversion: 2.87 time: 0.235782 Apr 12 00:50:42 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 302/901] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 00:50:42 2023] DELETE /compute/v2.1/servers/b0c7ca20-c237-43b0-9a75-2a21392c7fd0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 00:50:42 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-9702962e-907b-4c6a-a40f-444daa0c998e tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:50:42 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-9702962e-907b-4c6a-a40f-444daa0c998e tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:50:42 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=4 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:50:42 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=10 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:50:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9702962e-907b-4c6a-a40f-444daa0c998e tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:50:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9702962e-907b-4c6a-a40f-444daa0c998e tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:50:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9702962e-907b-4c6a-a40f-444daa0c998e tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:50:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9702962e-907b-4c6a-a40f-444daa0c998e tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:50:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9702962e-907b-4c6a-a40f-444daa0c998e tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:50:42 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9702962e-907b-4c6a-a40f-444daa0c998e tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:50:43 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-9702962e-907b-4c6a-a40f-444daa0c998e tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:50:43 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-9702962e-907b-4c6a-a40f-444daa0c998e tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:50:43 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-9702962e-907b-4c6a-a40f-444daa0c998e tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:50:43 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-9702962e-907b-4c6a-a40f-444daa0c998e tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0c7ca20-c237-43b0-9a75-2a21392c7fd0" status: 200 len: 1775 microversion: 2.87 time: 0.213991 Apr 12 00:50:43 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 302/902] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:50:42 2023] GET /compute/v2.1/servers/b0c7ca20-c237-43b0-9a75-2a21392c7fd0 => generated 1775 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:50:43 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:50:43 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:50:43 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-d881d9bc-2e76-41d8-a965-e943b926ec71 req-3c8c152c-2f34-45bb-9397-57c01a43349a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c7ca20-c237-43b0-9a75-2a21392c7fd0", "name": "network-vif-unplugged", "status": "completed", "tag": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:50:43 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d881d9bc-2e76-41d8-a965-e943b926ec71 req-3c8c152c-2f34-45bb-9397-57c01a43349a service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:50:43 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d881d9bc-2e76-41d8-a965-e943b926ec71 req-3c8c152c-2f34-45bb-9397-57c01a43349a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:50:43 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d881d9bc-2e76-41d8-a965-e943b926ec71 req-3c8c152c-2f34-45bb-9397-57c01a43349a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:50:43 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-d881d9bc-2e76-41d8-a965-e943b926ec71 req-3c8c152c-2f34-45bb-9397-57c01a43349a service nova] Creating event network-vif-unplugged:2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 on user Apr 12 00:50:43 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-d881d9bc-2e76-41d8-a965-e943b926ec71 req-3c8c152c-2f34-45bb-9397-57c01a43349a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034567 Apr 12 00:50:43 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 299/903] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:50:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:50:45 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-bc0de30a-88fe-45f7-91ea-ea1ecdeeefc9 req-e8017a2b-b630-4fb1-ab75-4081a934ab47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c7ca20-c237-43b0-9a75-2a21392c7fd0", "name": "network-vif-plugged", "status": "completed", "tag": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf"}, {"server_uuid": "b0c7ca20-c237-43b0-9a75-2a21392c7fd0", "name": "network-vif-deleted", "tag": "2f72a2ec-42e3-4239-bf22-a5ecc61aedcf"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:50:45 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-bc0de30a-88fe-45f7-91ea-ea1ecdeeefc9 req-e8017a2b-b630-4fb1-ab75-4081a934ab47 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:50:45 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-bc0de30a-88fe-45f7-91ea-ea1ecdeeefc9 req-e8017a2b-b630-4fb1-ab75-4081a934ab47 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:50:45 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-bc0de30a-88fe-45f7-91ea-ea1ecdeeefc9 req-e8017a2b-b630-4fb1-ab75-4081a934ab47 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:50:45 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-bc0de30a-88fe-45f7-91ea-ea1ecdeeefc9 req-e8017a2b-b630-4fb1-ab75-4081a934ab47 service nova] Creating event network-vif-plugged:2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 on user Apr 12 00:50:45 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-bc0de30a-88fe-45f7-91ea-ea1ecdeeefc9 req-e8017a2b-b630-4fb1-ab75-4081a934ab47 service nova] Creating event network-vif-deleted:2f72a2ec-42e3-4239-bf22-a5ecc61aedcf for instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 on user Apr 12 00:50:45 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-bc0de30a-88fe-45f7-91ea-ea1ecdeeefc9 req-e8017a2b-b630-4fb1-ab75-4081a934ab47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.082026 Apr 12 00:50:45 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 303/904] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:50:45 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:50:47 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-58e98704-6bef-4fb3-809d-9468dba39ff8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:50:47 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-58e98704-6bef-4fb3-809d-9468dba39ff8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:50:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-58e98704-6bef-4fb3-809d-9468dba39ff8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:50:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-58e98704-6bef-4fb3-809d-9468dba39ff8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:50:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-58e98704-6bef-4fb3-809d-9468dba39ff8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:50:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-58e98704-6bef-4fb3-809d-9468dba39ff8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:50:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-58e98704-6bef-4fb3-809d-9468dba39ff8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:50:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-58e98704-6bef-4fb3-809d-9468dba39ff8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:50:47 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-58e98704-6bef-4fb3-809d-9468dba39ff8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:50:47 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-58e98704-6bef-4fb3-809d-9468dba39ff8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749" status: 200 len: 1546 microversion: 2.1 time: 0.132870 Apr 12 00:50:47 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 303/905] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:50:47 2023] GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749 => generated 1546 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:51:15 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:51:15 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:51:15 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-6d71b82c-9290-4c5b-8f08-fcd84c65431d tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:51:15 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-6d71b82c-9290-4c5b-8f08-fcd84c65431d tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:51:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6d71b82c-9290-4c5b-8f08-fcd84c65431d tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6d71b82c-9290-4c5b-8f08-fcd84c65431d tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6d71b82c-9290-4c5b-8f08-fcd84c65431d tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6d71b82c-9290-4c5b-8f08-fcd84c65431d tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6d71b82c-9290-4c5b-8f08-fcd84c65431d tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6d71b82c-9290-4c5b-8f08-fcd84c65431d tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:16 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-6d71b82c-9290-4c5b-8f08-fcd84c65431d tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048848 Apr 12 00:51:16 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 300/906] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 00:51:15 2023] GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:51:16 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-e2acca90-383a-4cd9-a47f-9150850cb94e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:51:16 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-e2acca90-383a-4cd9-a47f-9150850cb94e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:51:16 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:51:16 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:51:16 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-e2acca90-383a-4cd9-a47f-9150850cb94e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:16 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-e2acca90-383a-4cd9-a47f-9150850cb94e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:16 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-e2acca90-383a-4cd9-a47f-9150850cb94e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:16 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-e2acca90-383a-4cd9-a47f-9150850cb94e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:16 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-e2acca90-383a-4cd9-a47f-9150850cb94e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:16 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-e2acca90-383a-4cd9-a47f-9150850cb94e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:16 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-e2acca90-383a-4cd9-a47f-9150850cb94e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] HTTP exception thrown: Instance 1fdb2b97-85b9-4e15-b586-948c3804da90 is not attached to volume 35254bb1-a5b6-4517-96c9-7d1df42532a5 Apr 12 00:51:16 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-e2acca90-383a-4cd9-a47f-9150850cb94e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Request method failure captured: Apr 12 00:51:16 user devstack@n-api.service[72496]: request: DELETE /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90/os-volume_attachments/35254bb1-a5b6-4517-96c9-7d1df42532a5 HTTP/1.1 Apr 12 00:51:16 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:51:16 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:51:16 user devstack@n-api.service[72496]: Connection: close Apr 12 00:51:16 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:51:16 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:51:16 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:51:16 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:51:16 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:51:16 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNf3_MXW68YWDhh4rdV6_s09Iac6VOPtMLVWpm0rGO_C1gJPbOzQvz6QNsDKExkr7tGyCe2GBMnyNIMBwvCofPc3o4pLjUWgkRI5V8Er_kr32XrEVpmyBXrjPzBF9_uy3WkbWoMTIlSDlSkI30Lw-qDUV_rwBUVs6oI9KWkfrbr0SVjY Apr 12 00:51:16 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:51:16 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:51:16 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:51:16 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:51:16 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:51:16 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:51:16 user devstack@n-api.service[72496]: X-Project-Id: e66fda80cb83402392e155c76ee78e1f Apr 12 00:51:16 user devstack@n-api.service[72496]: X-Project-Name: tempest-TestMinimumBasicScenario-1682364358 Apr 12 00:51:16 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:51:16 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:51:16 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e66fda80cb83402392e155c76ee78e1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e66fda80cb83402392e155c76ee78e1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e66fda80cb83402392e155c76ee78e1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:51:16 user devstack@n-api.service[72496]: X-Tenant: tempest-TestMinimumBasicScenario-1682364358 Apr 12 00:51:16 user devstack@n-api.service[72496]: X-Tenant-Id: e66fda80cb83402392e155c76ee78e1f Apr 12 00:51:16 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1682364358 Apr 12 00:51:16 user devstack@n-api.service[72496]: X-User: tempest-TestMinimumBasicScenario-1682364358-project-member Apr 12 00:51:16 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:51:16 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:51:16 user devstack@n-api.service[72496]: X-User-Id: 2842535891eb4a9880f7e8859dd0de3c Apr 12 00:51:16 user devstack@n-api.service[72496]: X-User-Name: tempest-TestMinimumBasicScenario-1682364358-project-member Apr 12 00:51:16 user devstack@n-api.service[72496]: method: > Apr 12 00:51:16 user devstack@n-api.service[72496]: exception: Instance 1fdb2b97-85b9-4e15-b586-948c3804da90 is not attached to volume 35254bb1-a5b6-4517-96c9-7d1df42532a5 Apr 12 00:51:16 user devstack@n-api.service[72496]: action_args: {'server_id': '1fdb2b97-85b9-4e15-b586-948c3804da90', 'id': '35254bb1-a5b6-4517-96c9-7d1df42532a5'} Apr 12 00:51:16 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 35254bb1-a5b6-4517-96c9-7d1df42532a5. Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fdb2b97-85b9-4e15-b586-948c3804da90 is not attached to volume 35254bb1-a5b6-4517-96c9-7d1df42532a5 Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fdb2b97-85b9-4e15-b586-948c3804da90 is not attached to volume 35254bb1-a5b6-4517-96c9-7d1df42532a5 Apr 12 00:51:16 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:51:16 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-e2acca90-383a-4cd9-a47f-9150850cb94e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Returning 404 to user: Instance 1fdb2b97-85b9-4e15-b586-948c3804da90 is not attached to volume 35254bb1-a5b6-4517-96c9-7d1df42532a5 {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:51:16 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-e2acca90-383a-4cd9-a47f-9150850cb94e tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90/os-volume_attachments/35254bb1-a5b6-4517-96c9-7d1df42532a5" status: 404 len: 154 microversion: 2.1 time: 0.120540 Apr 12 00:51:16 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 304/907] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 00:51:16 2023] DELETE /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90/os-volume_attachments/35254bb1-a5b6-4517-96c9-7d1df42532a5 => generated 154 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:51:18 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:51:18 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:51:18 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=6 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:51:18 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=12 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:51:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:18 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Going to try to terminate instance {{(pid=72494) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:51:18 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-3165c18f-b5e6-4757-b7b9-d4d6395d2720 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90" status: 204 len: 0 microversion: 2.1 time: 0.140746 Apr 12 00:51:18 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 304/908] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:51:18 2023] DELETE /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:51:18 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-de17598e-cbe4-410d-9524-752f3bc8b9db tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:51:18 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-de17598e-cbe4-410d-9524-752f3bc8b9db tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:51:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-de17598e-cbe4-410d-9524-752f3bc8b9db tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-de17598e-cbe4-410d-9524-752f3bc8b9db tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-de17598e-cbe4-410d-9524-752f3bc8b9db tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-de17598e-cbe4-410d-9524-752f3bc8b9db tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-de17598e-cbe4-410d-9524-752f3bc8b9db tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-de17598e-cbe4-410d-9524-752f3bc8b9db tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:18 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-de17598e-cbe4-410d-9524-752f3bc8b9db tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842535891eb4a9880f7e8859dd0de3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66fda80cb83402392e155c76ee78e1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:51:18 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-de17598e-cbe4-410d-9524-752f3bc8b9db tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90" status: 200 len: 1540 microversion: 2.1 time: 0.246163 Apr 12 00:51:18 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 301/909] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:51:18 2023] GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90 => generated 1540 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:51:18 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-050d9994-c54a-4d30-9e45-0db86f9c2166 req-cb765e87-6ffb-4c41-987d-355d89a038a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fdb2b97-85b9-4e15-b586-948c3804da90", "name": "network-vif-unplugged", "status": "completed", "tag": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:51:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-050d9994-c54a-4d30-9e45-0db86f9c2166 req-cb765e87-6ffb-4c41-987d-355d89a038a9 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-050d9994-c54a-4d30-9e45-0db86f9c2166 req-cb765e87-6ffb-4c41-987d-355d89a038a9 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-050d9994-c54a-4d30-9e45-0db86f9c2166 req-cb765e87-6ffb-4c41-987d-355d89a038a9 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:18 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-050d9994-c54a-4d30-9e45-0db86f9c2166 req-cb765e87-6ffb-4c41-987d-355d89a038a9 service nova] Creating event network-vif-unplugged:b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance 1fdb2b97-85b9-4e15-b586-948c3804da90 on user Apr 12 00:51:18 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-050d9994-c54a-4d30-9e45-0db86f9c2166 req-cb765e87-6ffb-4c41-987d-355d89a038a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088477 Apr 12 00:51:18 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 305/910] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:51:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:51:20 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-193bc211-6fa9-4083-9a27-f22558fd11d3 req-ff81d767-d913-4236-a347-9a4595d3f2a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fdb2b97-85b9-4e15-b586-948c3804da90", "name": "network-vif-deleted", "tag": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:51:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-193bc211-6fa9-4083-9a27-f22558fd11d3 req-ff81d767-d913-4236-a347-9a4595d3f2a7 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-193bc211-6fa9-4083-9a27-f22558fd11d3 req-ff81d767-d913-4236-a347-9a4595d3f2a7 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:20 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-193bc211-6fa9-4083-9a27-f22558fd11d3 req-ff81d767-d913-4236-a347-9a4595d3f2a7 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:20 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-193bc211-6fa9-4083-9a27-f22558fd11d3 req-ff81d767-d913-4236-a347-9a4595d3f2a7 service nova] Creating event network-vif-deleted:b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance 1fdb2b97-85b9-4e15-b586-948c3804da90 on user Apr 12 00:51:20 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-193bc211-6fa9-4083-9a27-f22558fd11d3 req-ff81d767-d913-4236-a347-9a4595d3f2a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107131 Apr 12 00:51:20 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 305/911] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:51:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:51:21 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fdb2b97-85b9-4e15-b586-948c3804da90", "name": "network-vif-plugged", "status": "completed", "tag": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7"}, {"server_uuid": "1fdb2b97-85b9-4e15-b586-948c3804da90", "name": "network-vif-plugged", "status": "completed", "tag": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7"}, {"server_uuid": "1fdb2b97-85b9-4e15-b586-948c3804da90", "name": "network-vif-plugged", "status": "completed", "tag": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7"}, {"server_uuid": "1fdb2b97-85b9-4e15-b586-948c3804da90", "name": "network-vif-plugged", "status": "completed", "tag": "b145d6f4-4a6d-4ab7-9797-6a0b15f165e7"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:51:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:21 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] Creating event network-vif-plugged:b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance 1fdb2b97-85b9-4e15-b586-948c3804da90 on user Apr 12 00:51:21 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] Creating event network-vif-plugged:b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance 1fdb2b97-85b9-4e15-b586-948c3804da90 on user Apr 12 00:51:21 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] Creating event network-vif-plugged:b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance 1fdb2b97-85b9-4e15-b586-948c3804da90 on user Apr 12 00:51:21 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] Creating event network-vif-plugged:b145d6f4-4a6d-4ab7-9797-6a0b15f165e7 for instance 1fdb2b97-85b9-4e15-b586-948c3804da90 on user Apr 12 00:51:21 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-29408c97-d980-4f66-a134-88fa11b3d706 req-09060e82-6ed2-4865-8930-b7b1d1617c1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.047489 Apr 12 00:51:21 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 302/912] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:51:21 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:51:23 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-0fd8223c-00bc-4cc7-8d49-1b28c157fbe2 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75e5c02c-524d-4965-85ea-092f7700dce2"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:51:23 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-0fd8223c-00bc-4cc7-8d49-1b28c157fbe2 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:51:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0fd8223c-00bc-4cc7-8d49-1b28c157fbe2 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0fd8223c-00bc-4cc7-8d49-1b28c157fbe2 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0fd8223c-00bc-4cc7-8d49-1b28c157fbe2 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0fd8223c-00bc-4cc7-8d49-1b28c157fbe2 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0fd8223c-00bc-4cc7-8d49-1b28c157fbe2 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0fd8223c-00bc-4cc7-8d49-1b28c157fbe2 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:24 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-0fd8223c-00bc-4cc7-8d49-1b28c157fbe2 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.341958 Apr 12 00:51:24 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 306/913] 10.0.0.210 () {66 vars in 1441 bytes} [Wed Apr 12 00:51:23 2023] POST /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580/os-volume_attachments => generated 188 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:51:24 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:51:24 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:51:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:24 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=72494) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 12 00:51:24 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-59bf34be-f2d5-4cca-bdbf-ac00a18f2d36 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580/action" status: 202 len: 0 microversion: 2.20 time: 0.139018 Apr 12 00:51:24 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 306/914] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 00:51:24 2023] POST /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:51:24 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-8d70928f-e7da-4ec6-83cb-96861af7fabc tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:51:24 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-8d70928f-e7da-4ec6-83cb-96861af7fabc tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:51:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8d70928f-e7da-4ec6-83cb-96861af7fabc tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8d70928f-e7da-4ec6-83cb-96861af7fabc tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8d70928f-e7da-4ec6-83cb-96861af7fabc tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8d70928f-e7da-4ec6-83cb-96861af7fabc tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8d70928f-e7da-4ec6-83cb-96861af7fabc tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8d70928f-e7da-4ec6-83cb-96861af7fabc tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:24 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-8d70928f-e7da-4ec6-83cb-96861af7fabc tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:51:24 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-8d70928f-e7da-4ec6-83cb-96861af7fabc tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:51:24 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-8d70928f-e7da-4ec6-83cb-96861af7fabc tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:51:24 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-8d70928f-e7da-4ec6-83cb-96861af7fabc tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580" status: 200 len: 1739 microversion: 2.20 time: 0.181394 Apr 12 00:51:24 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 303/915] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:51:24 2023] GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:51:31 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-479d59e1-f8b6-4645-8556-b64740f4da8c req-bcb2c989-f61b-47c3-a54e-f020b78684ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4d163ed-7900-486c-8b96-101af5547580", "tag": "f10369c7-25e6-4570-86a1-5e9ec3e941be"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:51:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-479d59e1-f8b6-4645-8556-b64740f4da8c req-bcb2c989-f61b-47c3-a54e-f020b78684ba service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-479d59e1-f8b6-4645-8556-b64740f4da8c req-bcb2c989-f61b-47c3-a54e-f020b78684ba service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-479d59e1-f8b6-4645-8556-b64740f4da8c req-bcb2c989-f61b-47c3-a54e-f020b78684ba service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:31 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-479d59e1-f8b6-4645-8556-b64740f4da8c req-bcb2c989-f61b-47c3-a54e-f020b78684ba service nova] Creating event network-changed:f10369c7-25e6-4570-86a1-5e9ec3e941be for instance a4d163ed-7900-486c-8b96-101af5547580 on user Apr 12 00:51:31 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-479d59e1-f8b6-4645-8556-b64740f4da8c req-bcb2c989-f61b-47c3-a54e-f020b78684ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031722 Apr 12 00:51:31 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 307/916] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:51:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:51:33 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-0daed508-7bf7-4db9-98af-118a32519a32 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:51:33 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-0daed508-7bf7-4db9-98af-118a32519a32 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: b0c7ca20-c237-43b0-9a75-2a21392c7fd0] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:51:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0daed508-7bf7-4db9-98af-118a32519a32 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0daed508-7bf7-4db9-98af-118a32519a32 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0daed508-7bf7-4db9-98af-118a32519a32 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0daed508-7bf7-4db9-98af-118a32519a32 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0daed508-7bf7-4db9-98af-118a32519a32 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0daed508-7bf7-4db9-98af-118a32519a32 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:33 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-0daed508-7bf7-4db9-98af-118a32519a32 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] HTTP exception thrown: Instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 could not be found. Apr 12 00:51:33 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-0daed508-7bf7-4db9-98af-118a32519a32 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Request method failure captured: Apr 12 00:51:33 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/b0c7ca20-c237-43b0-9a75-2a21392c7fd0 HTTP/1.1 Apr 12 00:51:33 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:51:33 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:51:33 user devstack@n-api.service[72494]: Connection: close Apr 12 00:51:33 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:51:33 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:51:33 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:51:33 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:51:33 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:51:33 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNfxj9gO1HNKLGMZ5qVVd8YIYI4eaaZGOkTgFy1_Fz3RMLJh8wUrmxj5MkjDmcvg9LwrVqbVXzjcBQgj902wMINTvczSjeLGip5dwuahyFYtgqN0m-7fZp1MvleZB3vs-ZJMA2WzjE9JrHO88T3Qu3mYRlEmrlG7Af29Z6G2IDISJfFg Apr 12 00:51:33 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:51:33 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:51:33 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:51:33 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:51:33 user devstack@n-api.service[72494]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 00:51:33 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:51:33 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:51:33 user devstack@n-api.service[72494]: X-Project-Id: f4a7eb4a2a09418eacdeaccefbf7de15 Apr 12 00:51:33 user devstack@n-api.service[72494]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-410532057 Apr 12 00:51:33 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:51:33 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:51:33 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4a7eb4a2a09418eacdeaccefbf7de15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f4a7eb4a2a09418eacdeaccefbf7de15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4a7eb4a2a09418eacdeaccefbf7de15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:51:33 user devstack@n-api.service[72494]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-410532057 Apr 12 00:51:33 user devstack@n-api.service[72494]: X-Tenant-Id: f4a7eb4a2a09418eacdeaccefbf7de15 Apr 12 00:51:33 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-410532057 Apr 12 00:51:33 user devstack@n-api.service[72494]: X-User: tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member Apr 12 00:51:33 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:51:33 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:51:33 user devstack@n-api.service[72494]: X-User-Id: 69d6e340820641729772cf35648ef785 Apr 12 00:51:33 user devstack@n-api.service[72494]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member Apr 12 00:51:33 user devstack@n-api.service[72494]: method: > Apr 12 00:51:33 user devstack@n-api.service[72494]: exception: Instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 could not be found. Apr 12 00:51:33 user devstack@n-api.service[72494]: action_args: {'id': 'b0c7ca20-c237-43b0-9a75-2a21392c7fd0'} Apr 12 00:51:33 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 could not be found. Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 could not be found. Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 could not be found. Apr 12 00:51:33 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:51:33 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-0daed508-7bf7-4db9-98af-118a32519a32 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Returning 404 to user: Instance b0c7ca20-c237-43b0-9a75-2a21392c7fd0 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:51:33 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-0daed508-7bf7-4db9-98af-118a32519a32 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0c7ca20-c237-43b0-9a75-2a21392c7fd0" status: 404 len: 111 microversion: 2.87 time: 0.030654 Apr 12 00:51:33 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 307/917] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:51:33 2023] GET /compute/v2.1/servers/b0c7ca20-c237-43b0-9a75-2a21392c7fd0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:51:33 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:51:33 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:51:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:33 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Going to try to terminate instance {{(pid=72495) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:51:33 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-45fa8a01-c066-4267-9ce8-7d2d800c665a tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/77f09d77-815b-4e7c-905d-b27ae017c9d5" status: 204 len: 0 microversion: 2.87 time: 0.113367 Apr 12 00:51:33 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 304/918] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 00:51:33 2023] DELETE /compute/v2.1/servers/77f09d77-815b-4e7c-905d-b27ae017c9d5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 00:51:33 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-12ec51b5-eade-4782-a0a8-8a04a0581fab tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:51:33 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-12ec51b5-eade-4782-a0a8-8a04a0581fab tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:51:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-12ec51b5-eade-4782-a0a8-8a04a0581fab tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-12ec51b5-eade-4782-a0a8-8a04a0581fab tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-12ec51b5-eade-4782-a0a8-8a04a0581fab tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-12ec51b5-eade-4782-a0a8-8a04a0581fab tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-12ec51b5-eade-4782-a0a8-8a04a0581fab tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-12ec51b5-eade-4782-a0a8-8a04a0581fab tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:33 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-12ec51b5-eade-4782-a0a8-8a04a0581fab tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:51:33 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-12ec51b5-eade-4782-a0a8-8a04a0581fab tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:51:33 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-12ec51b5-eade-4782-a0a8-8a04a0581fab tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:51:33 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-12ec51b5-eade-4782-a0a8-8a04a0581fab tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77f09d77-815b-4e7c-905d-b27ae017c9d5" status: 200 len: 1696 microversion: 2.87 time: 0.227909 Apr 12 00:51:33 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 308/919] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:51:33 2023] GET /compute/v2.1/servers/77f09d77-815b-4e7c-905d-b27ae017c9d5 => generated 1696 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:51:33 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-58617a92-5617-4463-beb8-fe3fab9e01bf req-8ecf8966-319d-44f2-b48c-4a6005c6fee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f09d77-815b-4e7c-905d-b27ae017c9d5", "name": "network-vif-unplugged", "status": "completed", "tag": "95181ee0-bb75-49a0-ad95-a2c225ff5f51"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:51:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-58617a92-5617-4463-beb8-fe3fab9e01bf req-8ecf8966-319d-44f2-b48c-4a6005c6fee7 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-58617a92-5617-4463-beb8-fe3fab9e01bf req-8ecf8966-319d-44f2-b48c-4a6005c6fee7 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-58617a92-5617-4463-beb8-fe3fab9e01bf req-8ecf8966-319d-44f2-b48c-4a6005c6fee7 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:33 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-58617a92-5617-4463-beb8-fe3fab9e01bf req-8ecf8966-319d-44f2-b48c-4a6005c6fee7 service nova] Creating event network-vif-unplugged:95181ee0-bb75-49a0-ad95-a2c225ff5f51 for instance 77f09d77-815b-4e7c-905d-b27ae017c9d5 on user Apr 12 00:51:33 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-58617a92-5617-4463-beb8-fe3fab9e01bf req-8ecf8966-319d-44f2-b48c-4a6005c6fee7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031964 Apr 12 00:51:33 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 308/920] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:51:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:51:36 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-1b914837-2af5-4806-9b8f-da51d3ab9682 req-29c9c36a-d707-4286-b626-c2eabb08ed5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f09d77-815b-4e7c-905d-b27ae017c9d5", "name": "network-vif-plugged", "status": "completed", "tag": "95181ee0-bb75-49a0-ad95-a2c225ff5f51"}, {"server_uuid": "77f09d77-815b-4e7c-905d-b27ae017c9d5", "name": "network-vif-deleted", "tag": "95181ee0-bb75-49a0-ad95-a2c225ff5f51"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:51:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-1b914837-2af5-4806-9b8f-da51d3ab9682 req-29c9c36a-d707-4286-b626-c2eabb08ed5f service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-1b914837-2af5-4806-9b8f-da51d3ab9682 req-29c9c36a-d707-4286-b626-c2eabb08ed5f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-1b914837-2af5-4806-9b8f-da51d3ab9682 req-29c9c36a-d707-4286-b626-c2eabb08ed5f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:36 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-1b914837-2af5-4806-9b8f-da51d3ab9682 req-29c9c36a-d707-4286-b626-c2eabb08ed5f service nova] Creating event network-vif-plugged:95181ee0-bb75-49a0-ad95-a2c225ff5f51 for instance 77f09d77-815b-4e7c-905d-b27ae017c9d5 on user Apr 12 00:51:36 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-1b914837-2af5-4806-9b8f-da51d3ab9682 req-29c9c36a-d707-4286-b626-c2eabb08ed5f service nova] Creating event network-vif-deleted:95181ee0-bb75-49a0-ad95-a2c225ff5f51 for instance 77f09d77-815b-4e7c-905d-b27ae017c9d5 on user Apr 12 00:51:36 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-1b914837-2af5-4806-9b8f-da51d3ab9682 req-29c9c36a-d707-4286-b626-c2eabb08ed5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031143 Apr 12 00:51:36 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 305/921] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:51:36 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:51:38 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-05f72b11-6c9e-4004-864e-204789bf68d2 req-abb65cbe-6538-48e2-8ae3-d2ae3768db52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d163ed-7900-486c-8b96-101af5547580", "name": "network-vif-plugged", "status": "completed", "tag": "f10369c7-25e6-4570-86a1-5e9ec3e941be"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:51:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-05f72b11-6c9e-4004-864e-204789bf68d2 req-abb65cbe-6538-48e2-8ae3-d2ae3768db52 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-05f72b11-6c9e-4004-864e-204789bf68d2 req-abb65cbe-6538-48e2-8ae3-d2ae3768db52 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-05f72b11-6c9e-4004-864e-204789bf68d2 req-abb65cbe-6538-48e2-8ae3-d2ae3768db52 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:38 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-05f72b11-6c9e-4004-864e-204789bf68d2 req-abb65cbe-6538-48e2-8ae3-d2ae3768db52 service nova] Creating event network-vif-plugged:f10369c7-25e6-4570-86a1-5e9ec3e941be for instance a4d163ed-7900-486c-8b96-101af5547580 on user Apr 12 00:51:38 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-05f72b11-6c9e-4004-864e-204789bf68d2 req-abb65cbe-6538-48e2-8ae3-d2ae3768db52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096624 Apr 12 00:51:38 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 309/922] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:51:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:51:40 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-c9e65c0b-8efe-4b54-b787-7846fc222c08 req-7c7242bd-2a09-4a63-a035-7028bd5d2c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d163ed-7900-486c-8b96-101af5547580", "name": "network-vif-plugged", "status": "completed", "tag": "f10369c7-25e6-4570-86a1-5e9ec3e941be"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:51:40 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-c9e65c0b-8efe-4b54-b787-7846fc222c08 req-7c7242bd-2a09-4a63-a035-7028bd5d2c82 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:40 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-c9e65c0b-8efe-4b54-b787-7846fc222c08 req-7c7242bd-2a09-4a63-a035-7028bd5d2c82 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:40 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-c9e65c0b-8efe-4b54-b787-7846fc222c08 req-7c7242bd-2a09-4a63-a035-7028bd5d2c82 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:40 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-c9e65c0b-8efe-4b54-b787-7846fc222c08 req-7c7242bd-2a09-4a63-a035-7028bd5d2c82 service nova] Creating event network-vif-plugged:f10369c7-25e6-4570-86a1-5e9ec3e941be for instance a4d163ed-7900-486c-8b96-101af5547580 on user Apr 12 00:51:40 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-c9e65c0b-8efe-4b54-b787-7846fc222c08 req-7c7242bd-2a09-4a63-a035-7028bd5d2c82 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038998 Apr 12 00:51:40 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 309/923] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:51:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:51:47 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:51:47 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:51:47 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-20b3cbc0-b8d6-42a2-b65e-428549826fd6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:51:47 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-20b3cbc0-b8d6-42a2-b65e-428549826fd6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:51:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-20b3cbc0-b8d6-42a2-b65e-428549826fd6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-20b3cbc0-b8d6-42a2-b65e-428549826fd6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-20b3cbc0-b8d6-42a2-b65e-428549826fd6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-20b3cbc0-b8d6-42a2-b65e-428549826fd6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-20b3cbc0-b8d6-42a2-b65e-428549826fd6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:47 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-20b3cbc0-b8d6-42a2-b65e-428549826fd6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:47 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-20b3cbc0-b8d6-42a2-b65e-428549826fd6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:51:47 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-20b3cbc0-b8d6-42a2-b65e-428549826fd6 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749" status: 200 len: 1546 microversion: 2.1 time: 0.363920 Apr 12 00:51:47 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 306/924] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:51:47 2023] GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749 => generated 1546 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:51:47 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-52af22db-70ba-4c07-aef5-79d28a7f51c7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:51:47 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-52af22db-70ba-4c07-aef5-79d28a7f51c7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:51:47 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=15 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:51:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-52af22db-70ba-4c07-aef5-79d28a7f51c7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-52af22db-70ba-4c07-aef5-79d28a7f51c7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-52af22db-70ba-4c07-aef5-79d28a7f51c7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-52af22db-70ba-4c07-aef5-79d28a7f51c7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-52af22db-70ba-4c07-aef5-79d28a7f51c7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:47 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-52af22db-70ba-4c07-aef5-79d28a7f51c7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:47 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=34,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:51:48 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-52af22db-70ba-4c07-aef5-79d28a7f51c7 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749/action" status: 200 len: 28338 microversion: 2.1 time: 0.213957 Apr 12 00:51:48 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 310/925] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 00:51:47 2023] POST /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749/action => generated 28338 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:51:48 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-687d4500-feb1-47e9-b283-f9d60ee742a0 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:51:48 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-687d4500-feb1-47e9-b283-f9d60ee742a0 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:51:48 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-687d4500-feb1-47e9-b283-f9d60ee742a0 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:48 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-687d4500-feb1-47e9-b283-f9d60ee742a0 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:48 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-687d4500-feb1-47e9-b283-f9d60ee742a0 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:48 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-687d4500-feb1-47e9-b283-f9d60ee742a0 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:51:48 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-687d4500-feb1-47e9-b283-f9d60ee742a0 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:51:48 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-687d4500-feb1-47e9-b283-f9d60ee742a0 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:51:48 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-687d4500-feb1-47e9-b283-f9d60ee742a0 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:51:48 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:51:48 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-687d4500-feb1-47e9-b283-f9d60ee742a0 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84861eef-6d59-448b-b6b7-eb8dd8e47b30" status: 200 len: 1540 microversion: 2.1 time: 0.468142 Apr 12 00:51:48 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 310/926] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:51:48 2023] GET /compute/v2.1/servers/84861eef-6d59-448b-b6b7-eb8dd8e47b30 => generated 1540 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:52:08 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:52:08 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:52:08 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-dda5a810-13bb-49e6-890a-15f29bef4603 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:52:08 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-dda5a810-13bb-49e6-890a-15f29bef4603 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] [instance: 1fdb2b97-85b9-4e15-b586-948c3804da90] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:52:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dda5a810-13bb-49e6-890a-15f29bef4603 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:52:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dda5a810-13bb-49e6-890a-15f29bef4603 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:52:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dda5a810-13bb-49e6-890a-15f29bef4603 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:52:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dda5a810-13bb-49e6-890a-15f29bef4603 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:52:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dda5a810-13bb-49e6-890a-15f29bef4603 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:52:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-dda5a810-13bb-49e6-890a-15f29bef4603 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:52:09 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-dda5a810-13bb-49e6-890a-15f29bef4603 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] HTTP exception thrown: Instance 1fdb2b97-85b9-4e15-b586-948c3804da90 could not be found. Apr 12 00:52:09 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-dda5a810-13bb-49e6-890a-15f29bef4603 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Request method failure captured: Apr 12 00:52:09 user devstack@n-api.service[72495]: request: GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90 HTTP/1.1 Apr 12 00:52:09 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:52:09 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:52:09 user devstack@n-api.service[72495]: Connection: close Apr 12 00:52:09 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 00:52:09 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:52:09 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:52:09 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:52:09 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:52:09 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNf3_MXW68YWDhh4rdV6_s09Iac6VOPtMLVWpm0rGO_C1gJPbOzQvz6QNsDKExkr7tGyCe2GBMnyNIMBwvCofPc3o4pLjUWgkRI5V8Er_kr32XrEVpmyBXrjPzBF9_uy3WkbWoMTIlSDlSkI30Lw-qDUV_rwBUVs6oI9KWkfrbr0SVjY Apr 12 00:52:09 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:52:09 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:52:09 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:52:09 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:52:09 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:52:09 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:52:09 user devstack@n-api.service[72495]: X-Project-Id: e66fda80cb83402392e155c76ee78e1f Apr 12 00:52:09 user devstack@n-api.service[72495]: X-Project-Name: tempest-TestMinimumBasicScenario-1682364358 Apr 12 00:52:09 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:52:09 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:52:09 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e66fda80cb83402392e155c76ee78e1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e66fda80cb83402392e155c76ee78e1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e66fda80cb83402392e155c76ee78e1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:52:09 user devstack@n-api.service[72495]: X-Tenant: tempest-TestMinimumBasicScenario-1682364358 Apr 12 00:52:09 user devstack@n-api.service[72495]: X-Tenant-Id: e66fda80cb83402392e155c76ee78e1f Apr 12 00:52:09 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1682364358 Apr 12 00:52:09 user devstack@n-api.service[72495]: X-User: tempest-TestMinimumBasicScenario-1682364358-project-member Apr 12 00:52:09 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:52:09 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:52:09 user devstack@n-api.service[72495]: X-User-Id: 2842535891eb4a9880f7e8859dd0de3c Apr 12 00:52:09 user devstack@n-api.service[72495]: X-User-Name: tempest-TestMinimumBasicScenario-1682364358-project-member Apr 12 00:52:09 user devstack@n-api.service[72495]: method: > Apr 12 00:52:09 user devstack@n-api.service[72495]: exception: Instance 1fdb2b97-85b9-4e15-b586-948c3804da90 could not be found. Apr 12 00:52:09 user devstack@n-api.service[72495]: action_args: {'id': '1fdb2b97-85b9-4e15-b586-948c3804da90'} Apr 12 00:52:09 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fdb2b97-85b9-4e15-b586-948c3804da90 could not be found. Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fdb2b97-85b9-4e15-b586-948c3804da90 could not be found. Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fdb2b97-85b9-4e15-b586-948c3804da90 could not be found. Apr 12 00:52:09 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:52:09 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-dda5a810-13bb-49e6-890a-15f29bef4603 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Returning 404 to user: Instance 1fdb2b97-85b9-4e15-b586-948c3804da90 could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:52:09 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-dda5a810-13bb-49e6-890a-15f29bef4603 tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90" status: 404 len: 111 microversion: 2.1 time: 0.177349 Apr 12 00:52:09 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 307/927] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:52:08 2023] GET /compute/v2.1/servers/1fdb2b97-85b9-4e15-b586-948c3804da90 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:52:09 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-534bc44e-b3dc-4a5d-ad12-60c7c78aeead tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] Calling method '.version_select at 0x7f7cd4670310>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:52:09 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:52:09 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=3 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:52:09 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-534bc44e-b3dc-4a5d-ad12-60c7c78aeead tempest-TestMinimumBasicScenario-1682364358 tempest-TestMinimumBasicScenario-1682364358-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-609117724" status: 202 len: 0 microversion: 2.1 time: 0.028179 Apr 12 00:52:09 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 311/928] 10.0.0.210 () {62 vars in 1346 bytes} [Wed Apr 12 00:52:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-609117724 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:52:14 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-3b6160e4-9330-46e2-81ad-7e368d3f4bb0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:52:14 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-3b6160e4-9330-46e2-81ad-7e368d3f4bb0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:52:14 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:52:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3b6160e4-9330-46e2-81ad-7e368d3f4bb0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:52:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3b6160e4-9330-46e2-81ad-7e368d3f4bb0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:52:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3b6160e4-9330-46e2-81ad-7e368d3f4bb0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:52:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3b6160e4-9330-46e2-81ad-7e368d3f4bb0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:52:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3b6160e4-9330-46e2-81ad-7e368d3f4bb0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:52:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3b6160e4-9330-46e2-81ad-7e368d3f4bb0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:52:15 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-3b6160e4-9330-46e2-81ad-7e368d3f4bb0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:52:15 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-3b6160e4-9330-46e2-81ad-7e368d3f4bb0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:52:15 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-3b6160e4-9330-46e2-81ad-7e368d3f4bb0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:52:15 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-3b6160e4-9330-46e2-81ad-7e368d3f4bb0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580" status: 200 len: 1784 microversion: 2.20 time: 0.189270 Apr 12 00:52:15 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 311/929] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:52:14 2023] GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580 => generated 1784 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:52:23 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-268e048e-0eb4-420e-80a4-2ff39ad12fa0 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:52:23 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-268e048e-0eb4-420e-80a4-2ff39ad12fa0 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 77f09d77-815b-4e7c-905d-b27ae017c9d5] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:52:23 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:52:23 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:52:23 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-268e048e-0eb4-420e-80a4-2ff39ad12fa0 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:52:23 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-268e048e-0eb4-420e-80a4-2ff39ad12fa0 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:52:23 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-268e048e-0eb4-420e-80a4-2ff39ad12fa0 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:52:23 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-268e048e-0eb4-420e-80a4-2ff39ad12fa0 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:52:23 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-268e048e-0eb4-420e-80a4-2ff39ad12fa0 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:52:23 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-268e048e-0eb4-420e-80a4-2ff39ad12fa0 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:52:23 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-268e048e-0eb4-420e-80a4-2ff39ad12fa0 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] HTTP exception thrown: Instance 77f09d77-815b-4e7c-905d-b27ae017c9d5 could not be found. Apr 12 00:52:23 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-268e048e-0eb4-420e-80a4-2ff39ad12fa0 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Request method failure captured: Apr 12 00:52:23 user devstack@n-api.service[72495]: request: GET /compute/v2.1/servers/77f09d77-815b-4e7c-905d-b27ae017c9d5 HTTP/1.1 Apr 12 00:52:23 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:52:23 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:52:23 user devstack@n-api.service[72495]: Connection: close Apr 12 00:52:23 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 00:52:23 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:52:23 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:52:23 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:52:23 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:52:23 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNfxj9gO1HNKLGMZ5qVVd8YIYI4eaaZGOkTgFy1_Fz3RMLJh8wUrmxj5MkjDmcvg9LwrVqbVXzjcBQgj902wMINTvczSjeLGip5dwuahyFYtgqN0m-7fZp1MvleZB3vs-ZJMA2WzjE9JrHO88T3Qu3mYRlEmrlG7Af29Z6G2IDISJfFg Apr 12 00:52:23 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:52:23 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:52:23 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:52:23 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:52:23 user devstack@n-api.service[72495]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 00:52:23 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:52:23 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:52:23 user devstack@n-api.service[72495]: X-Project-Id: f4a7eb4a2a09418eacdeaccefbf7de15 Apr 12 00:52:23 user devstack@n-api.service[72495]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-410532057 Apr 12 00:52:23 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:52:23 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:52:23 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4a7eb4a2a09418eacdeaccefbf7de15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f4a7eb4a2a09418eacdeaccefbf7de15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4a7eb4a2a09418eacdeaccefbf7de15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:52:23 user devstack@n-api.service[72495]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-410532057 Apr 12 00:52:23 user devstack@n-api.service[72495]: X-Tenant-Id: f4a7eb4a2a09418eacdeaccefbf7de15 Apr 12 00:52:23 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-410532057 Apr 12 00:52:23 user devstack@n-api.service[72495]: X-User: tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member Apr 12 00:52:23 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:52:23 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:52:23 user devstack@n-api.service[72495]: X-User-Id: 69d6e340820641729772cf35648ef785 Apr 12 00:52:23 user devstack@n-api.service[72495]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member Apr 12 00:52:23 user devstack@n-api.service[72495]: method: > Apr 12 00:52:23 user devstack@n-api.service[72495]: exception: Instance 77f09d77-815b-4e7c-905d-b27ae017c9d5 could not be found. Apr 12 00:52:23 user devstack@n-api.service[72495]: action_args: {'id': '77f09d77-815b-4e7c-905d-b27ae017c9d5'} Apr 12 00:52:23 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f09d77-815b-4e7c-905d-b27ae017c9d5 could not be found. Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f09d77-815b-4e7c-905d-b27ae017c9d5 could not be found. Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f09d77-815b-4e7c-905d-b27ae017c9d5 could not be found. Apr 12 00:52:23 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:52:23 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-268e048e-0eb4-420e-80a4-2ff39ad12fa0 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Returning 404 to user: Instance 77f09d77-815b-4e7c-905d-b27ae017c9d5 could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:52:23 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-268e048e-0eb4-420e-80a4-2ff39ad12fa0 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77f09d77-815b-4e7c-905d-b27ae017c9d5" status: 404 len: 111 microversion: 2.87 time: 0.038664 Apr 12 00:52:23 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 308/930] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:52:23 2023] GET /compute/v2.1/servers/77f09d77-815b-4e7c-905d-b27ae017c9d5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:52:23 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:52:23 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:52:23 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:52:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:52:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:52:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:52:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:52:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:52:23 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:52:24 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Going to try to terminate instance {{(pid=72496) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:52:24 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-bd5ec2d9-07a1-46d8-8978-a77c2e972967 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1277a40a-6389-4d88-bbc6-bda27d465c35" status: 204 len: 0 microversion: 2.87 time: 0.114953 Apr 12 00:52:24 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 312/931] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 00:52:23 2023] DELETE /compute/v2.1/servers/1277a40a-6389-4d88-bbc6-bda27d465c35 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 00:52:24 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-1511ea87-ebc1-474d-a7c7-362f654ab313 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:52:24 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-1511ea87-ebc1-474d-a7c7-362f654ab313 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:52:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1511ea87-ebc1-474d-a7c7-362f654ab313 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:52:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1511ea87-ebc1-474d-a7c7-362f654ab313 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:52:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1511ea87-ebc1-474d-a7c7-362f654ab313 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:52:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1511ea87-ebc1-474d-a7c7-362f654ab313 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:52:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1511ea87-ebc1-474d-a7c7-362f654ab313 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:52:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1511ea87-ebc1-474d-a7c7-362f654ab313 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:52:24 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-1511ea87-ebc1-474d-a7c7-362f654ab313 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:52:24 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-1511ea87-ebc1-474d-a7c7-362f654ab313 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:52:24 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-1511ea87-ebc1-474d-a7c7-362f654ab313 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:52:24 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-1511ea87-ebc1-474d-a7c7-362f654ab313 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1277a40a-6389-4d88-bbc6-bda27d465c35" status: 200 len: 1774 microversion: 2.87 time: 0.259870 Apr 12 00:52:24 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 312/932] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:52:24 2023] GET /compute/v2.1/servers/1277a40a-6389-4d88-bbc6-bda27d465c35 => generated 1774 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:52:24 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-c896e803-856a-43da-a080-59b637555ba5 req-10956ef9-40ed-4757-8730-5ab35f8c6483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1277a40a-6389-4d88-bbc6-bda27d465c35", "name": "network-vif-unplugged", "status": "completed", "tag": "8e32719d-1d2e-439a-9dba-9ac82140fbac"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:52:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-c896e803-856a-43da-a080-59b637555ba5 req-10956ef9-40ed-4757-8730-5ab35f8c6483 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:52:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-c896e803-856a-43da-a080-59b637555ba5 req-10956ef9-40ed-4757-8730-5ab35f8c6483 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:52:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-c896e803-856a-43da-a080-59b637555ba5 req-10956ef9-40ed-4757-8730-5ab35f8c6483 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:52:24 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-c896e803-856a-43da-a080-59b637555ba5 req-10956ef9-40ed-4757-8730-5ab35f8c6483 service nova] Creating event network-vif-unplugged:8e32719d-1d2e-439a-9dba-9ac82140fbac for instance 1277a40a-6389-4d88-bbc6-bda27d465c35 on user Apr 12 00:52:24 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-c896e803-856a-43da-a080-59b637555ba5 req-10956ef9-40ed-4757-8730-5ab35f8c6483 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044732 Apr 12 00:52:24 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 309/933] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:52:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:52:25 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-029fa17f-d83d-4a79-89e2-26e0ee37ddeb req-e0e92e94-5c8a-42b2-8d13-63470669559e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1277a40a-6389-4d88-bbc6-bda27d465c35", "name": "network-vif-deleted", "tag": "8e32719d-1d2e-439a-9dba-9ac82140fbac"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:52:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-029fa17f-d83d-4a79-89e2-26e0ee37ddeb req-e0e92e94-5c8a-42b2-8d13-63470669559e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:52:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-029fa17f-d83d-4a79-89e2-26e0ee37ddeb req-e0e92e94-5c8a-42b2-8d13-63470669559e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:52:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-029fa17f-d83d-4a79-89e2-26e0ee37ddeb req-e0e92e94-5c8a-42b2-8d13-63470669559e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:52:25 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-029fa17f-d83d-4a79-89e2-26e0ee37ddeb req-e0e92e94-5c8a-42b2-8d13-63470669559e service nova] Creating event network-vif-deleted:8e32719d-1d2e-439a-9dba-9ac82140fbac for instance 1277a40a-6389-4d88-bbc6-bda27d465c35 on user Apr 12 00:52:25 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-029fa17f-d83d-4a79-89e2-26e0ee37ddeb req-e0e92e94-5c8a-42b2-8d13-63470669559e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029859 Apr 12 00:52:25 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 313/934] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:52:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:52:26 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-3ed0a048-719b-4e0f-bc8e-5af9abf4a16c req-54d5f323-ac86-420b-8db2-fba27b4223f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1277a40a-6389-4d88-bbc6-bda27d465c35", "name": "network-vif-plugged", "status": "completed", "tag": "8e32719d-1d2e-439a-9dba-9ac82140fbac"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:52:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-3ed0a048-719b-4e0f-bc8e-5af9abf4a16c req-54d5f323-ac86-420b-8db2-fba27b4223f6 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:52:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-3ed0a048-719b-4e0f-bc8e-5af9abf4a16c req-54d5f323-ac86-420b-8db2-fba27b4223f6 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:52:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-3ed0a048-719b-4e0f-bc8e-5af9abf4a16c req-54d5f323-ac86-420b-8db2-fba27b4223f6 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:52:26 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-3ed0a048-719b-4e0f-bc8e-5af9abf4a16c req-54d5f323-ac86-420b-8db2-fba27b4223f6 service nova] Creating event network-vif-plugged:8e32719d-1d2e-439a-9dba-9ac82140fbac for instance 1277a40a-6389-4d88-bbc6-bda27d465c35 on user Apr 12 00:52:26 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-3ed0a048-719b-4e0f-bc8e-5af9abf4a16c req-54d5f323-ac86-420b-8db2-fba27b4223f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031196 Apr 12 00:52:26 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 313/935] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:52:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:52:48 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:52:48 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:52:48 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:52:48 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:52:48 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:52:48 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:52:48 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:52:48 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:52:48 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:52:48 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:52:48 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Going to try to terminate instance {{(pid=72495) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:52:48 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-88e51284-41da-4c95-8caa-eb93c3ecc76c tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749" status: 204 len: 0 microversion: 2.1 time: 0.137505 Apr 12 00:52:48 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 310/936] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:52:48 2023] DELETE /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:52:48 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:52:48 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:52:48 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-af4104d8-9631-460c-850e-4a4db0c1ed5f tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:52:48 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-af4104d8-9631-460c-850e-4a4db0c1ed5f tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:52:48 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-af4104d8-9631-460c-850e-4a4db0c1ed5f tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:52:48 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-af4104d8-9631-460c-850e-4a4db0c1ed5f tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:52:48 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-af4104d8-9631-460c-850e-4a4db0c1ed5f tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:52:48 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-af4104d8-9631-460c-850e-4a4db0c1ed5f tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:52:48 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-af4104d8-9631-460c-850e-4a4db0c1ed5f tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:52:48 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-af4104d8-9631-460c-850e-4a4db0c1ed5f tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:52:49 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-af4104d8-9631-460c-850e-4a4db0c1ed5f tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:52:49 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-af4104d8-9631-460c-850e-4a4db0c1ed5f tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749" status: 200 len: 1552 microversion: 2.1 time: 0.167943 Apr 12 00:52:49 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 314/937] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:52:48 2023] GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749 => generated 1552 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:52:49 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=8 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:52:49 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=15 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:52:49 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-30a89ac9-2838-40b4-b284-9df2346b2213 req-56ee2aac-ea2c-42c4-a527-7ec8ce8497b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f4b0ac-f740-46b5-99f1-4129cccf1749", "name": "network-vif-unplugged", "status": "completed", "tag": "6014f3cd-13ce-4fba-9cba-057192db2b3d"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:52:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-30a89ac9-2838-40b4-b284-9df2346b2213 req-56ee2aac-ea2c-42c4-a527-7ec8ce8497b2 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:52:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-30a89ac9-2838-40b4-b284-9df2346b2213 req-56ee2aac-ea2c-42c4-a527-7ec8ce8497b2 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:52:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-30a89ac9-2838-40b4-b284-9df2346b2213 req-56ee2aac-ea2c-42c4-a527-7ec8ce8497b2 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:52:49 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-30a89ac9-2838-40b4-b284-9df2346b2213 req-56ee2aac-ea2c-42c4-a527-7ec8ce8497b2 service nova] Creating event network-vif-unplugged:6014f3cd-13ce-4fba-9cba-057192db2b3d for instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 on user Apr 12 00:52:49 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-30a89ac9-2838-40b4-b284-9df2346b2213 req-56ee2aac-ea2c-42c4-a527-7ec8ce8497b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037297 Apr 12 00:52:49 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 314/938] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:52:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:52:51 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-8baf4a3a-45b9-4427-bfb8-0b3ee35c0933 req-2b5e8082-aa09-4ada-b4cc-0e43e151983f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f4b0ac-f740-46b5-99f1-4129cccf1749", "name": "network-vif-plugged", "status": "completed", "tag": "6014f3cd-13ce-4fba-9cba-057192db2b3d"}, {"server_uuid": "c7f4b0ac-f740-46b5-99f1-4129cccf1749", "name": "network-vif-deleted", "tag": "6014f3cd-13ce-4fba-9cba-057192db2b3d"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:52:51 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8baf4a3a-45b9-4427-bfb8-0b3ee35c0933 req-2b5e8082-aa09-4ada-b4cc-0e43e151983f service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:52:51 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8baf4a3a-45b9-4427-bfb8-0b3ee35c0933 req-2b5e8082-aa09-4ada-b4cc-0e43e151983f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:52:51 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8baf4a3a-45b9-4427-bfb8-0b3ee35c0933 req-2b5e8082-aa09-4ada-b4cc-0e43e151983f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:52:51 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-8baf4a3a-45b9-4427-bfb8-0b3ee35c0933 req-2b5e8082-aa09-4ada-b4cc-0e43e151983f service nova] Creating event network-vif-plugged:6014f3cd-13ce-4fba-9cba-057192db2b3d for instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 on user Apr 12 00:52:51 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-8baf4a3a-45b9-4427-bfb8-0b3ee35c0933 req-2b5e8082-aa09-4ada-b4cc-0e43e151983f service nova] Creating event network-vif-deleted:6014f3cd-13ce-4fba-9cba-057192db2b3d for instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 on user Apr 12 00:52:51 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-8baf4a3a-45b9-4427-bfb8-0b3ee35c0933 req-2b5e8082-aa09-4ada-b4cc-0e43e151983f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036994 Apr 12 00:52:51 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 311/939] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:52:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:53:14 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-154670f5-b4e7-4249-9cb1-68feb0a4b733 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:53:14 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-154670f5-b4e7-4249-9cb1-68feb0a4b733 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: 1277a40a-6389-4d88-bbc6-bda27d465c35] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:53:14 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:53:14 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:53:14 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-154670f5-b4e7-4249-9cb1-68feb0a4b733 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:14 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-154670f5-b4e7-4249-9cb1-68feb0a4b733 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:14 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-154670f5-b4e7-4249-9cb1-68feb0a4b733 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:14 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-154670f5-b4e7-4249-9cb1-68feb0a4b733 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:14 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-154670f5-b4e7-4249-9cb1-68feb0a4b733 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:14 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-154670f5-b4e7-4249-9cb1-68feb0a4b733 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:14 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-154670f5-b4e7-4249-9cb1-68feb0a4b733 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] HTTP exception thrown: Instance 1277a40a-6389-4d88-bbc6-bda27d465c35 could not be found. Apr 12 00:53:14 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-154670f5-b4e7-4249-9cb1-68feb0a4b733 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Request method failure captured: Apr 12 00:53:14 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/1277a40a-6389-4d88-bbc6-bda27d465c35 HTTP/1.1 Apr 12 00:53:14 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:53:14 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:53:14 user devstack@n-api.service[72496]: Connection: close Apr 12 00:53:14 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:53:14 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:53:14 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:53:14 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:53:14 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:53:14 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNfxj9gO1HNKLGMZ5qVVd8YIYI4eaaZGOkTgFy1_Fz3RMLJh8wUrmxj5MkjDmcvg9LwrVqbVXzjcBQgj902wMINTvczSjeLGip5dwuahyFYtgqN0m-7fZp1MvleZB3vs-ZJMA2WzjE9JrHO88T3Qu3mYRlEmrlG7Af29Z6G2IDISJfFg Apr 12 00:53:14 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:53:14 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:53:14 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:53:14 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:53:14 user devstack@n-api.service[72496]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 00:53:14 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:53:14 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:53:14 user devstack@n-api.service[72496]: X-Project-Id: f4a7eb4a2a09418eacdeaccefbf7de15 Apr 12 00:53:14 user devstack@n-api.service[72496]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-410532057 Apr 12 00:53:14 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:53:14 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:53:14 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4a7eb4a2a09418eacdeaccefbf7de15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f4a7eb4a2a09418eacdeaccefbf7de15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4a7eb4a2a09418eacdeaccefbf7de15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:53:14 user devstack@n-api.service[72496]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-410532057 Apr 12 00:53:14 user devstack@n-api.service[72496]: X-Tenant-Id: f4a7eb4a2a09418eacdeaccefbf7de15 Apr 12 00:53:14 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-410532057 Apr 12 00:53:14 user devstack@n-api.service[72496]: X-User: tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member Apr 12 00:53:14 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:53:14 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:53:14 user devstack@n-api.service[72496]: X-User-Id: 69d6e340820641729772cf35648ef785 Apr 12 00:53:14 user devstack@n-api.service[72496]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member Apr 12 00:53:14 user devstack@n-api.service[72496]: method: > Apr 12 00:53:14 user devstack@n-api.service[72496]: exception: Instance 1277a40a-6389-4d88-bbc6-bda27d465c35 could not be found. Apr 12 00:53:14 user devstack@n-api.service[72496]: action_args: {'id': '1277a40a-6389-4d88-bbc6-bda27d465c35'} Apr 12 00:53:14 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1277a40a-6389-4d88-bbc6-bda27d465c35 could not be found. Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1277a40a-6389-4d88-bbc6-bda27d465c35 could not be found. Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1277a40a-6389-4d88-bbc6-bda27d465c35 could not be found. Apr 12 00:53:14 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:53:14 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-154670f5-b4e7-4249-9cb1-68feb0a4b733 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Returning 404 to user: Instance 1277a40a-6389-4d88-bbc6-bda27d465c35 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:53:14 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-154670f5-b4e7-4249-9cb1-68feb0a4b733 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1277a40a-6389-4d88-bbc6-bda27d465c35" status: 404 len: 111 microversion: 2.87 time: 0.036819 Apr 12 00:53:14 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 315/940] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:53:14 2023] GET /compute/v2.1/servers/1277a40a-6389-4d88-bbc6-bda27d465c35 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:53:14 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:53:14 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:53:14 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:53:14 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:53:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:14 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Going to try to terminate instance {{(pid=72494) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:53:14 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-8da25641-0ce6-462b-8318-4baa09094f70 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" status: 204 len: 0 microversion: 2.87 time: 0.126290 Apr 12 00:53:14 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 315/941] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 00:53:14 2023] DELETE /compute/v2.1/servers/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 12 00:53:14 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:53:14 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:53:14 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-6e3b7262-9cb8-4b98-aff2-287245fb2225 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:53:14 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-6e3b7262-9cb8-4b98-aff2-287245fb2225 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:53:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6e3b7262-9cb8-4b98-aff2-287245fb2225 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6e3b7262-9cb8-4b98-aff2-287245fb2225 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6e3b7262-9cb8-4b98-aff2-287245fb2225 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6e3b7262-9cb8-4b98-aff2-287245fb2225 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6e3b7262-9cb8-4b98-aff2-287245fb2225 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:14 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6e3b7262-9cb8-4b98-aff2-287245fb2225 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:14 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-6e3b7262-9cb8-4b98-aff2-287245fb2225 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:53:14 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-6e3b7262-9cb8-4b98-aff2-287245fb2225 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:53:14 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-6e3b7262-9cb8-4b98-aff2-287245fb2225 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69d6e340820641729772cf35648ef785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4a7eb4a2a09418eacdeaccefbf7de15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:53:14 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-6e3b7262-9cb8-4b98-aff2-287245fb2225 tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" status: 200 len: 1698 microversion: 2.87 time: 0.197285 Apr 12 00:53:14 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 312/942] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:53:14 2023] GET /compute/v2.1/servers/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 => generated 1698 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:53:15 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-c25c0f4f-f71d-4d6c-8087-d684d4ee66bb req-10e9d2cd-d394-4a89-a53f-ec156ffdd01f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88", "name": "network-vif-unplugged", "status": "completed", "tag": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:53:15 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-c25c0f4f-f71d-4d6c-8087-d684d4ee66bb req-10e9d2cd-d394-4a89-a53f-ec156ffdd01f service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:15 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-c25c0f4f-f71d-4d6c-8087-d684d4ee66bb req-10e9d2cd-d394-4a89-a53f-ec156ffdd01f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:15 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-c25c0f4f-f71d-4d6c-8087-d684d4ee66bb req-10e9d2cd-d394-4a89-a53f-ec156ffdd01f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:15 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-c25c0f4f-f71d-4d6c-8087-d684d4ee66bb req-10e9d2cd-d394-4a89-a53f-ec156ffdd01f service nova] Creating event network-vif-unplugged:203d6c33-a06b-4c9a-88e9-dbd8e823a6e5 for instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 on user Apr 12 00:53:15 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-c25c0f4f-f71d-4d6c-8087-d684d4ee66bb req-10e9d2cd-d394-4a89-a53f-ec156ffdd01f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032761 Apr 12 00:53:15 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 316/943] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:53:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:53:15 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-a3cfd5bc-3fa8-4eb8-a2c9-a2b0efe1d141 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:53:15 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-a3cfd5bc-3fa8-4eb8-a2c9-a2b0efe1d141 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:53:15 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a3cfd5bc-3fa8-4eb8-a2c9-a2b0efe1d141 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:15 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a3cfd5bc-3fa8-4eb8-a2c9-a2b0efe1d141 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:15 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a3cfd5bc-3fa8-4eb8-a2c9-a2b0efe1d141 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:15 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a3cfd5bc-3fa8-4eb8-a2c9-a2b0efe1d141 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:15 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a3cfd5bc-3fa8-4eb8-a2c9-a2b0efe1d141 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:15 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-a3cfd5bc-3fa8-4eb8-a2c9-a2b0efe1d141 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:15 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-a3cfd5bc-3fa8-4eb8-a2c9-a2b0efe1d141 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580/os-volume_attachments/75e5c02c-524d-4965-85ea-092f7700dce2" status: 200 len: 194 microversion: 2.20 time: 0.297272 Apr 12 00:53:15 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 316/944] 10.0.0.210 () {64 vars in 1531 bytes} [Wed Apr 12 00:53:15 2023] GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580/os-volume_attachments/75e5c02c-524d-4965-85ea-092f7700dce2 => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:53:15 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:53:15 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:53:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:15 user devstack@n-api.service[72495]: DEBUG nova.objects.instance [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'services' on Instance uuid a4d163ed-7900-486c-8b96-101af5547580 {{(pid=72495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:53:15 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-c852a9be-4058-401b-883a-33cbd31c711d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580/os-volume_attachments/75e5c02c-524d-4965-85ea-092f7700dce2" status: 202 len: 0 microversion: 2.20 time: 0.193145 Apr 12 00:53:15 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 313/945] 10.0.0.210 () {64 vars in 1534 bytes} [Wed Apr 12 00:53:15 2023] DELETE /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580/os-volume_attachments/75e5c02c-524d-4965-85ea-092f7700dce2 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:53:15 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-71f66363-7ae5-491f-b2ab-ab9cf5e462ec tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:53:15 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-71f66363-7ae5-491f-b2ab-ab9cf5e462ec tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:53:15 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-71f66363-7ae5-491f-b2ab-ab9cf5e462ec tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:15 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-71f66363-7ae5-491f-b2ab-ab9cf5e462ec tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:15 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-71f66363-7ae5-491f-b2ab-ab9cf5e462ec tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:15 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-71f66363-7ae5-491f-b2ab-ab9cf5e462ec tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:15 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-71f66363-7ae5-491f-b2ab-ab9cf5e462ec tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:15 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-71f66363-7ae5-491f-b2ab-ab9cf5e462ec tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:15 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-71f66363-7ae5-491f-b2ab-ab9cf5e462ec tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042123 Apr 12 00:53:15 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 317/946] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 00:53:15 2023] GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:53:16 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-384c12f9-c44d-4464-b823-bee24e78d477 req-476161d0-8c1f-4bce-8132-c0d41a5e3f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88", "name": "network-vif-deleted", "tag": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:53:16 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-384c12f9-c44d-4464-b823-bee24e78d477 req-476161d0-8c1f-4bce-8132-c0d41a5e3f7a service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:16 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-384c12f9-c44d-4464-b823-bee24e78d477 req-476161d0-8c1f-4bce-8132-c0d41a5e3f7a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:16 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-384c12f9-c44d-4464-b823-bee24e78d477 req-476161d0-8c1f-4bce-8132-c0d41a5e3f7a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:16 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-384c12f9-c44d-4464-b823-bee24e78d477 req-476161d0-8c1f-4bce-8132-c0d41a5e3f7a service nova] Creating event network-vif-deleted:203d6c33-a06b-4c9a-88e9-dbd8e823a6e5 for instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 on user Apr 12 00:53:16 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-384c12f9-c44d-4464-b823-bee24e78d477 req-476161d0-8c1f-4bce-8132-c0d41a5e3f7a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032013 Apr 12 00:53:16 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 317/947] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:53:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:53:17 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-86e03386-c39b-41be-8455-e44f9de41e51 req-a2764b95-2f30-4adb-ac5d-69beeb9a6f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88", "name": "network-vif-plugged", "status": "completed", "tag": "203d6c33-a06b-4c9a-88e9-dbd8e823a6e5"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:53:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-86e03386-c39b-41be-8455-e44f9de41e51 req-a2764b95-2f30-4adb-ac5d-69beeb9a6f6b service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-86e03386-c39b-41be-8455-e44f9de41e51 req-a2764b95-2f30-4adb-ac5d-69beeb9a6f6b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:17 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-86e03386-c39b-41be-8455-e44f9de41e51 req-a2764b95-2f30-4adb-ac5d-69beeb9a6f6b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:17 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-86e03386-c39b-41be-8455-e44f9de41e51 req-a2764b95-2f30-4adb-ac5d-69beeb9a6f6b service nova] Creating event network-vif-plugged:203d6c33-a06b-4c9a-88e9-dbd8e823a6e5 for instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 on user Apr 12 00:53:17 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-86e03386-c39b-41be-8455-e44f9de41e51 req-a2764b95-2f30-4adb-ac5d-69beeb9a6f6b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029581 Apr 12 00:53:17 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 314/948] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:53:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:53:39 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:53:39 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=10 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:53:39 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-1d654715-866c-421f-ae82-51f588dc665b tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:53:39 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-1d654715-866c-421f-ae82-51f588dc665b tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:53:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1d654715-866c-421f-ae82-51f588dc665b tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1d654715-866c-421f-ae82-51f588dc665b tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1d654715-866c-421f-ae82-51f588dc665b tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1d654715-866c-421f-ae82-51f588dc665b tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1d654715-866c-421f-ae82-51f588dc665b tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1d654715-866c-421f-ae82-51f588dc665b tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:39 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-1d654715-866c-421f-ae82-51f588dc665b tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] HTTP exception thrown: Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 could not be found. Apr 12 00:53:39 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-1d654715-866c-421f-ae82-51f588dc665b tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Request method failure captured: Apr 12 00:53:39 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749 HTTP/1.1 Apr 12 00:53:39 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:53:39 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:53:39 user devstack@n-api.service[72496]: Connection: close Apr 12 00:53:39 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:53:39 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:53:39 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:53:39 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:53:39 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:53:39 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNft8pxUfRov3VWMJsz3neTVP7vjPZrPoG_D_RpQWIM-EEGVf8w5xREov2D3rG8pVUGFFc4iIpAW0aRk2Z5TmADpnstC41AikbDOkY4nppdui0mYCGWq3s8swIvjZVz3SyGIqiVTX7Hr0WxRb2aVDp1_7Es2G3Qsunn_AD4oFLvHyF9g Apr 12 00:53:39 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:53:39 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:53:39 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:53:39 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:53:39 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:53:39 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:53:39 user devstack@n-api.service[72496]: X-Project-Id: d8ba626fdf264b879099a89097845153 Apr 12 00:53:39 user devstack@n-api.service[72496]: X-Project-Name: tempest-ServerActionsTestJSON-674156571 Apr 12 00:53:39 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:53:39 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:53:39 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8ba626fdf264b879099a89097845153"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d8ba626fdf264b879099a89097845153"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8ba626fdf264b879099a89097845153"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:53:39 user devstack@n-api.service[72496]: X-Tenant: tempest-ServerActionsTestJSON-674156571 Apr 12 00:53:39 user devstack@n-api.service[72496]: X-Tenant-Id: d8ba626fdf264b879099a89097845153 Apr 12 00:53:39 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-ServerActionsTestJSON-674156571 Apr 12 00:53:39 user devstack@n-api.service[72496]: X-User: tempest-ServerActionsTestJSON-674156571-project-member Apr 12 00:53:39 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:53:39 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:53:39 user devstack@n-api.service[72496]: X-User-Id: d658147b4def4d12a16381d4c19357e3 Apr 12 00:53:39 user devstack@n-api.service[72496]: X-User-Name: tempest-ServerActionsTestJSON-674156571-project-member Apr 12 00:53:39 user devstack@n-api.service[72496]: method: > Apr 12 00:53:39 user devstack@n-api.service[72496]: exception: Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 could not be found. Apr 12 00:53:39 user devstack@n-api.service[72496]: action_args: {'id': 'c7f4b0ac-f740-46b5-99f1-4129cccf1749'} Apr 12 00:53:39 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 could not be found. Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 could not be found. Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 could not be found. Apr 12 00:53:39 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:53:39 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-1d654715-866c-421f-ae82-51f588dc665b tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Returning 404 to user: Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:53:39 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-1d654715-866c-421f-ae82-51f588dc665b tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749" status: 404 len: 111 microversion: 2.1 time: 0.035587 Apr 12 00:53:39 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 318/949] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:53:39 2023] GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:53:39 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:53:39 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:53:39 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-9d13608d-f2e4-4045-beb8-084c62fc1f92 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:53:39 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-9d13608d-f2e4-4045-beb8-084c62fc1f92 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:53:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9d13608d-f2e4-4045-beb8-084c62fc1f92 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9d13608d-f2e4-4045-beb8-084c62fc1f92 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9d13608d-f2e4-4045-beb8-084c62fc1f92 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9d13608d-f2e4-4045-beb8-084c62fc1f92 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9d13608d-f2e4-4045-beb8-084c62fc1f92 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9d13608d-f2e4-4045-beb8-084c62fc1f92 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:39 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-9d13608d-f2e4-4045-beb8-084c62fc1f92 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] HTTP exception thrown: Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 could not be found. Apr 12 00:53:39 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-9d13608d-f2e4-4045-beb8-084c62fc1f92 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Request method failure captured: Apr 12 00:53:39 user devstack@n-api.service[72494]: request: DELETE /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749 HTTP/1.1 Apr 12 00:53:39 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:53:39 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:53:39 user devstack@n-api.service[72494]: Connection: close Apr 12 00:53:39 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:53:39 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:53:39 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:53:39 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:53:39 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:53:39 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNft8pxUfRov3VWMJsz3neTVP7vjPZrPoG_D_RpQWIM-EEGVf8w5xREov2D3rG8pVUGFFc4iIpAW0aRk2Z5TmADpnstC41AikbDOkY4nppdui0mYCGWq3s8swIvjZVz3SyGIqiVTX7Hr0WxRb2aVDp1_7Es2G3Qsunn_AD4oFLvHyF9g Apr 12 00:53:39 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:53:39 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:53:39 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:53:39 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:53:39 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:53:39 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:53:39 user devstack@n-api.service[72494]: X-Project-Id: d8ba626fdf264b879099a89097845153 Apr 12 00:53:39 user devstack@n-api.service[72494]: X-Project-Name: tempest-ServerActionsTestJSON-674156571 Apr 12 00:53:39 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:53:39 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:53:39 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8ba626fdf264b879099a89097845153"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d8ba626fdf264b879099a89097845153"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8ba626fdf264b879099a89097845153"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:53:39 user devstack@n-api.service[72494]: X-Tenant: tempest-ServerActionsTestJSON-674156571 Apr 12 00:53:39 user devstack@n-api.service[72494]: X-Tenant-Id: d8ba626fdf264b879099a89097845153 Apr 12 00:53:39 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-ServerActionsTestJSON-674156571 Apr 12 00:53:39 user devstack@n-api.service[72494]: X-User: tempest-ServerActionsTestJSON-674156571-project-member Apr 12 00:53:39 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:53:39 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:53:39 user devstack@n-api.service[72494]: X-User-Id: d658147b4def4d12a16381d4c19357e3 Apr 12 00:53:39 user devstack@n-api.service[72494]: X-User-Name: tempest-ServerActionsTestJSON-674156571-project-member Apr 12 00:53:39 user devstack@n-api.service[72494]: method: > Apr 12 00:53:39 user devstack@n-api.service[72494]: exception: Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 could not be found. Apr 12 00:53:39 user devstack@n-api.service[72494]: action_args: {'id': 'c7f4b0ac-f740-46b5-99f1-4129cccf1749'} Apr 12 00:53:39 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 could not be found. Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 could not be found. Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 could not be found. Apr 12 00:53:39 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:53:39 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-9d13608d-f2e4-4045-beb8-084c62fc1f92 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Returning 404 to user: Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:53:39 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-9d13608d-f2e4-4045-beb8-084c62fc1f92 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749" status: 404 len: 111 microversion: 2.1 time: 0.037210 Apr 12 00:53:39 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 318/950] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:53:39 2023] DELETE /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:53:39 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=8 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:53:39 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:53:39 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-71a023b2-81dc-4f12-a195-1fe99f0b8bfd tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:53:39 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-71a023b2-81dc-4f12-a195-1fe99f0b8bfd tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: c7f4b0ac-f740-46b5-99f1-4129cccf1749] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:53:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-71a023b2-81dc-4f12-a195-1fe99f0b8bfd tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-71a023b2-81dc-4f12-a195-1fe99f0b8bfd tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-71a023b2-81dc-4f12-a195-1fe99f0b8bfd tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-71a023b2-81dc-4f12-a195-1fe99f0b8bfd tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-71a023b2-81dc-4f12-a195-1fe99f0b8bfd tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-71a023b2-81dc-4f12-a195-1fe99f0b8bfd tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:39 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-71a023b2-81dc-4f12-a195-1fe99f0b8bfd tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] HTTP exception thrown: Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 could not be found. Apr 12 00:53:39 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-71a023b2-81dc-4f12-a195-1fe99f0b8bfd tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Request method failure captured: Apr 12 00:53:39 user devstack@n-api.service[72495]: request: GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749 HTTP/1.1 Apr 12 00:53:39 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:53:39 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:53:39 user devstack@n-api.service[72495]: Connection: close Apr 12 00:53:39 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 00:53:39 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:53:39 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:53:39 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:53:39 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:53:39 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNft8pxUfRov3VWMJsz3neTVP7vjPZrPoG_D_RpQWIM-EEGVf8w5xREov2D3rG8pVUGFFc4iIpAW0aRk2Z5TmADpnstC41AikbDOkY4nppdui0mYCGWq3s8swIvjZVz3SyGIqiVTX7Hr0WxRb2aVDp1_7Es2G3Qsunn_AD4oFLvHyF9g Apr 12 00:53:39 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:53:39 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:53:39 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:53:39 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:53:39 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:53:39 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:53:39 user devstack@n-api.service[72495]: X-Project-Id: d8ba626fdf264b879099a89097845153 Apr 12 00:53:39 user devstack@n-api.service[72495]: X-Project-Name: tempest-ServerActionsTestJSON-674156571 Apr 12 00:53:39 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:53:39 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:53:39 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8ba626fdf264b879099a89097845153"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d8ba626fdf264b879099a89097845153"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8ba626fdf264b879099a89097845153"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:53:39 user devstack@n-api.service[72495]: X-Tenant: tempest-ServerActionsTestJSON-674156571 Apr 12 00:53:39 user devstack@n-api.service[72495]: X-Tenant-Id: d8ba626fdf264b879099a89097845153 Apr 12 00:53:39 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-ServerActionsTestJSON-674156571 Apr 12 00:53:39 user devstack@n-api.service[72495]: X-User: tempest-ServerActionsTestJSON-674156571-project-member Apr 12 00:53:39 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:53:39 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:53:39 user devstack@n-api.service[72495]: X-User-Id: d658147b4def4d12a16381d4c19357e3 Apr 12 00:53:39 user devstack@n-api.service[72495]: X-User-Name: tempest-ServerActionsTestJSON-674156571-project-member Apr 12 00:53:39 user devstack@n-api.service[72495]: method: > Apr 12 00:53:39 user devstack@n-api.service[72495]: exception: Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 could not be found. Apr 12 00:53:39 user devstack@n-api.service[72495]: action_args: {'id': 'c7f4b0ac-f740-46b5-99f1-4129cccf1749'} Apr 12 00:53:39 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 could not be found. Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 could not be found. Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 could not be found. Apr 12 00:53:39 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:53:39 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-71a023b2-81dc-4f12-a195-1fe99f0b8bfd tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Returning 404 to user: Instance c7f4b0ac-f740-46b5-99f1-4129cccf1749 could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:53:39 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-71a023b2-81dc-4f12-a195-1fe99f0b8bfd tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749" status: 404 len: 111 microversion: 2.1 time: 0.035660 Apr 12 00:53:39 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 315/951] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:53:39 2023] GET /compute/v2.1/servers/c7f4b0ac-f740-46b5-99f1-4129cccf1749 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:53:39 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:53:39 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:53:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:39 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:39 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Going to try to terminate instance {{(pid=72496) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:53:39 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-04d90012-d7e4-4b05-83e7-1f8d9d49f8db tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/84861eef-6d59-448b-b6b7-eb8dd8e47b30" status: 204 len: 0 microversion: 2.1 time: 0.118655 Apr 12 00:53:39 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 319/952] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:53:39 2023] DELETE /compute/v2.1/servers/84861eef-6d59-448b-b6b7-eb8dd8e47b30 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:53:39 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-552c3f38-0780-4752-9a08-03105bd1b148 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:53:39 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-552c3f38-0780-4752-9a08-03105bd1b148 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:53:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-552c3f38-0780-4752-9a08-03105bd1b148 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-552c3f38-0780-4752-9a08-03105bd1b148 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-552c3f38-0780-4752-9a08-03105bd1b148 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-552c3f38-0780-4752-9a08-03105bd1b148 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-552c3f38-0780-4752-9a08-03105bd1b148 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-552c3f38-0780-4752-9a08-03105bd1b148 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:39 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-552c3f38-0780-4752-9a08-03105bd1b148 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd658147b4def4d12a16381d4c19357e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba626fdf264b879099a89097845153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:53:39 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-552c3f38-0780-4752-9a08-03105bd1b148 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84861eef-6d59-448b-b6b7-eb8dd8e47b30" status: 200 len: 1546 microversion: 2.1 time: 0.218552 Apr 12 00:53:39 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 319/953] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:53:39 2023] GET /compute/v2.1/servers/84861eef-6d59-448b-b6b7-eb8dd8e47b30 => generated 1546 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:53:39 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-37a13795-8369-4bd6-a2c5-956b29906696 req-d6135693-d3eb-4b52-a8f0-bab0dbd199c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84861eef-6d59-448b-b6b7-eb8dd8e47b30", "name": "network-vif-unplugged", "status": "completed", "tag": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:53:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-37a13795-8369-4bd6-a2c5-956b29906696 req-d6135693-d3eb-4b52-a8f0-bab0dbd199c9 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-37a13795-8369-4bd6-a2c5-956b29906696 req-d6135693-d3eb-4b52-a8f0-bab0dbd199c9 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-37a13795-8369-4bd6-a2c5-956b29906696 req-d6135693-d3eb-4b52-a8f0-bab0dbd199c9 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:39 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-37a13795-8369-4bd6-a2c5-956b29906696 req-d6135693-d3eb-4b52-a8f0-bab0dbd199c9 service nova] Creating event network-vif-unplugged:df061f79-7574-4b3c-9cf4-2b0e61c5efc1 for instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30 on user Apr 12 00:53:39 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-37a13795-8369-4bd6-a2c5-956b29906696 req-d6135693-d3eb-4b52-a8f0-bab0dbd199c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028958 Apr 12 00:53:39 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 316/954] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:53:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:53:40 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-285454b8-3623-44af-9ecb-3502c74cba4c req-59fee84f-0582-4d03-826a-403a55ee6117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84861eef-6d59-448b-b6b7-eb8dd8e47b30", "name": "network-vif-deleted", "tag": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:53:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-285454b8-3623-44af-9ecb-3502c74cba4c req-59fee84f-0582-4d03-826a-403a55ee6117 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-285454b8-3623-44af-9ecb-3502c74cba4c req-59fee84f-0582-4d03-826a-403a55ee6117 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-285454b8-3623-44af-9ecb-3502c74cba4c req-59fee84f-0582-4d03-826a-403a55ee6117 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:40 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-285454b8-3623-44af-9ecb-3502c74cba4c req-59fee84f-0582-4d03-826a-403a55ee6117 service nova] Creating event network-vif-deleted:df061f79-7574-4b3c-9cf4-2b0e61c5efc1 for instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30 on user Apr 12 00:53:40 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-285454b8-3623-44af-9ecb-3502c74cba4c req-59fee84f-0582-4d03-826a-403a55ee6117 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032711 Apr 12 00:53:40 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 320/955] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:53:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:53:41 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-2b42cca1-7390-4a46-86bb-95e82cfd97ac req-8b6f15e4-8f2d-4fa7-a751-5e305759aaf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84861eef-6d59-448b-b6b7-eb8dd8e47b30", "name": "network-vif-plugged", "status": "completed", "tag": "df061f79-7574-4b3c-9cf4-2b0e61c5efc1"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:53:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-2b42cca1-7390-4a46-86bb-95e82cfd97ac req-8b6f15e4-8f2d-4fa7-a751-5e305759aaf5 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:53:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-2b42cca1-7390-4a46-86bb-95e82cfd97ac req-8b6f15e4-8f2d-4fa7-a751-5e305759aaf5 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:53:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-2b42cca1-7390-4a46-86bb-95e82cfd97ac req-8b6f15e4-8f2d-4fa7-a751-5e305759aaf5 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:53:41 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-2b42cca1-7390-4a46-86bb-95e82cfd97ac req-8b6f15e4-8f2d-4fa7-a751-5e305759aaf5 service nova] Creating event network-vif-plugged:df061f79-7574-4b3c-9cf4-2b0e61c5efc1 for instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30 on user Apr 12 00:53:41 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-2b42cca1-7390-4a46-86bb-95e82cfd97ac req-8b6f15e4-8f2d-4fa7-a751-5e305759aaf5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029339 Apr 12 00:53:41 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 320/956] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:53:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:54:05 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:05 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:05 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-cd95ab9e-1ab6-405c-94c9-72589553585e tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:54:05 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-cd95ab9e-1ab6-405c-94c9-72589553585e tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] [instance: a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:54:05 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cd95ab9e-1ab6-405c-94c9-72589553585e tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:05 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cd95ab9e-1ab6-405c-94c9-72589553585e tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:05 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cd95ab9e-1ab6-405c-94c9-72589553585e tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:05 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cd95ab9e-1ab6-405c-94c9-72589553585e tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:05 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cd95ab9e-1ab6-405c-94c9-72589553585e tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:05 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-cd95ab9e-1ab6-405c-94c9-72589553585e tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:05 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-cd95ab9e-1ab6-405c-94c9-72589553585e tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] HTTP exception thrown: Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 could not be found. Apr 12 00:54:05 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-cd95ab9e-1ab6-405c-94c9-72589553585e tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Request method failure captured: Apr 12 00:54:05 user devstack@n-api.service[72495]: request: GET /compute/v2.1/servers/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 HTTP/1.1 Apr 12 00:54:05 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:54:05 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:54:05 user devstack@n-api.service[72495]: Connection: close Apr 12 00:54:05 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 00:54:05 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:54:05 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:54:05 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:54:05 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:54:05 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNfxj9gO1HNKLGMZ5qVVd8YIYI4eaaZGOkTgFy1_Fz3RMLJh8wUrmxj5MkjDmcvg9LwrVqbVXzjcBQgj902wMINTvczSjeLGip5dwuahyFYtgqN0m-7fZp1MvleZB3vs-ZJMA2WzjE9JrHO88T3Qu3mYRlEmrlG7Af29Z6G2IDISJfFg Apr 12 00:54:05 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:54:05 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:54:05 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:54:05 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:54:05 user devstack@n-api.service[72495]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 00:54:05 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:54:05 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:54:05 user devstack@n-api.service[72495]: X-Project-Id: f4a7eb4a2a09418eacdeaccefbf7de15 Apr 12 00:54:05 user devstack@n-api.service[72495]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-410532057 Apr 12 00:54:05 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:54:05 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:54:05 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4a7eb4a2a09418eacdeaccefbf7de15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f4a7eb4a2a09418eacdeaccefbf7de15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f4a7eb4a2a09418eacdeaccefbf7de15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:54:05 user devstack@n-api.service[72495]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-410532057 Apr 12 00:54:05 user devstack@n-api.service[72495]: X-Tenant-Id: f4a7eb4a2a09418eacdeaccefbf7de15 Apr 12 00:54:05 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-410532057 Apr 12 00:54:05 user devstack@n-api.service[72495]: X-User: tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member Apr 12 00:54:05 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:54:05 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:54:05 user devstack@n-api.service[72495]: X-User-Id: 69d6e340820641729772cf35648ef785 Apr 12 00:54:05 user devstack@n-api.service[72495]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member Apr 12 00:54:05 user devstack@n-api.service[72495]: method: > Apr 12 00:54:05 user devstack@n-api.service[72495]: exception: Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 could not be found. Apr 12 00:54:05 user devstack@n-api.service[72495]: action_args: {'id': 'a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88'} Apr 12 00:54:05 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 could not be found. Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 could not be found. Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 could not be found. Apr 12 00:54:05 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:54:05 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-cd95ab9e-1ab6-405c-94c9-72589553585e tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] Returning 404 to user: Instance a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:54:05 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-cd95ab9e-1ab6-405c-94c9-72589553585e tempest-ServerBootFromVolumeStableRescueTest-410532057 tempest-ServerBootFromVolumeStableRescueTest-410532057-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88" status: 404 len: 111 microversion: 2.87 time: 0.035983 Apr 12 00:54:05 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 317/957] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:54:05 2023] GET /compute/v2.1/servers/a551281a-4f0c-4bfa-8ac8-e1b10cfbbb88 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:54:05 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:05 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:05 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-2a510c4a-500a-48ff-8c3f-c1d7a22cd4a9 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:54:05 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-2a510c4a-500a-48ff-8c3f-c1d7a22cd4a9 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:54:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2a510c4a-500a-48ff-8c3f-c1d7a22cd4a9 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2a510c4a-500a-48ff-8c3f-c1d7a22cd4a9 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2a510c4a-500a-48ff-8c3f-c1d7a22cd4a9 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2a510c4a-500a-48ff-8c3f-c1d7a22cd4a9 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2a510c4a-500a-48ff-8c3f-c1d7a22cd4a9 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2a510c4a-500a-48ff-8c3f-c1d7a22cd4a9 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:05 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-2a510c4a-500a-48ff-8c3f-c1d7a22cd4a9 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057238 Apr 12 00:54:05 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 321/958] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 00:54:05 2023] GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:54:05 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=6 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:05 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=10 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:05 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:54:05 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:54:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:05 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Going to try to terminate instance {{(pid=72494) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:54:06 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-8d40a613-8d03-467c-b8c1-9ca09e4cc440 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580" status: 204 len: 0 microversion: 2.20 time: 0.243280 Apr 12 00:54:06 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 321/959] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 00:54:05 2023] DELETE /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 00:54:06 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-7c862bb1-66b2-4e23-88b2-1dca75d78cc8 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:54:06 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-7c862bb1-66b2-4e23-88b2-1dca75d78cc8 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:54:06 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7c862bb1-66b2-4e23-88b2-1dca75d78cc8 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:06 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7c862bb1-66b2-4e23-88b2-1dca75d78cc8 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:06 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7c862bb1-66b2-4e23-88b2-1dca75d78cc8 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:06 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7c862bb1-66b2-4e23-88b2-1dca75d78cc8 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:06 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7c862bb1-66b2-4e23-88b2-1dca75d78cc8 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:06 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7c862bb1-66b2-4e23-88b2-1dca75d78cc8 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:06 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-7c862bb1-66b2-4e23-88b2-1dca75d78cc8 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:54:06 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-7c862bb1-66b2-4e23-88b2-1dca75d78cc8 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:54:06 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-7c862bb1-66b2-4e23-88b2-1dca75d78cc8 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:54:06 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-7c862bb1-66b2-4e23-88b2-1dca75d78cc8 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580" status: 200 len: 1712 microversion: 2.20 time: 0.327694 Apr 12 00:54:06 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 318/960] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:54:06 2023] GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580 => generated 1712 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 00:54:06 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-a9d0a8cc-39ad-4d21-8081-4f4e23d9db37 req-9c2c4649-2a47-4da3-aa31-c3409f94ebbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d163ed-7900-486c-8b96-101af5547580", "name": "network-vif-unplugged", "status": "completed", "tag": "f10369c7-25e6-4570-86a1-5e9ec3e941be"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:54:06 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-a9d0a8cc-39ad-4d21-8081-4f4e23d9db37 req-9c2c4649-2a47-4da3-aa31-c3409f94ebbd service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:06 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-a9d0a8cc-39ad-4d21-8081-4f4e23d9db37 req-9c2c4649-2a47-4da3-aa31-c3409f94ebbd service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:06 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-a9d0a8cc-39ad-4d21-8081-4f4e23d9db37 req-9c2c4649-2a47-4da3-aa31-c3409f94ebbd service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:06 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-a9d0a8cc-39ad-4d21-8081-4f4e23d9db37 req-9c2c4649-2a47-4da3-aa31-c3409f94ebbd service nova] Creating event network-vif-unplugged:f10369c7-25e6-4570-86a1-5e9ec3e941be for instance a4d163ed-7900-486c-8b96-101af5547580 on user Apr 12 00:54:06 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-a9d0a8cc-39ad-4d21-8081-4f4e23d9db37 req-9c2c4649-2a47-4da3-aa31-c3409f94ebbd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047164 Apr 12 00:54:06 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 322/961] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:54:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:54:08 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-54f73b6a-6f2a-470e-932d-9d4cb29b729c req-b7817859-47da-447e-8fe6-43f0b205f33a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d163ed-7900-486c-8b96-101af5547580", "name": "network-vif-deleted", "tag": "f10369c7-25e6-4570-86a1-5e9ec3e941be"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:54:08 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-54f73b6a-6f2a-470e-932d-9d4cb29b729c req-b7817859-47da-447e-8fe6-43f0b205f33a service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:08 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-54f73b6a-6f2a-470e-932d-9d4cb29b729c req-b7817859-47da-447e-8fe6-43f0b205f33a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:08 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-54f73b6a-6f2a-470e-932d-9d4cb29b729c req-b7817859-47da-447e-8fe6-43f0b205f33a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:08 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-54f73b6a-6f2a-470e-932d-9d4cb29b729c req-b7817859-47da-447e-8fe6-43f0b205f33a service nova] Creating event network-vif-deleted:f10369c7-25e6-4570-86a1-5e9ec3e941be for instance a4d163ed-7900-486c-8b96-101af5547580 on user Apr 12 00:54:08 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-54f73b6a-6f2a-470e-932d-9d4cb29b729c req-b7817859-47da-447e-8fe6-43f0b205f33a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033772 Apr 12 00:54:08 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 322/962] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:54:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:54:08 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-d061382b-5e5f-4693-bc37-57cfe5ccc839 req-f61692e1-8785-4c92-abe9-eb6e286409db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4d163ed-7900-486c-8b96-101af5547580", "name": "network-vif-plugged", "status": "completed", "tag": "f10369c7-25e6-4570-86a1-5e9ec3e941be"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:54:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d061382b-5e5f-4693-bc37-57cfe5ccc839 req-f61692e1-8785-4c92-abe9-eb6e286409db service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d061382b-5e5f-4693-bc37-57cfe5ccc839 req-f61692e1-8785-4c92-abe9-eb6e286409db service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d061382b-5e5f-4693-bc37-57cfe5ccc839 req-f61692e1-8785-4c92-abe9-eb6e286409db service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:08 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-d061382b-5e5f-4693-bc37-57cfe5ccc839 req-f61692e1-8785-4c92-abe9-eb6e286409db service nova] Creating event network-vif-plugged:f10369c7-25e6-4570-86a1-5e9ec3e941be for instance a4d163ed-7900-486c-8b96-101af5547580 on user Apr 12 00:54:08 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-d061382b-5e5f-4693-bc37-57cfe5ccc839 req-f61692e1-8785-4c92-abe9-eb6e286409db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030421 Apr 12 00:54:08 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 319/963] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:54:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:54:16 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:16 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=8 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:16 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2085542410", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "networks": [{"uuid": "49b3318f-9e48-43d8-97b1-1a2ec225e079"}]}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:54:16 user devstack@n-api.service[72496]: DEBUG nova.network.neutron [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] validate_networks() for [('49b3318f-9e48-43d8-97b1-1a2ec225e079', None, None, None, None, None)] {{(pid=72496) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:54:17 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Flavor limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:54:17 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Image limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:54:17 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Flavor pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:54:17 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Image pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:54:17 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:54:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:17 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Getting quotas for project 38c3f0ad11ac49aaaec0a9c1827ddadb. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:54:17 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Getting quotas for user 845fc21f48594cb28ac9c770612a1830 and project 38c3f0ad11ac49aaaec0a9c1827ddadb. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:54:17 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Going to run 1 instances... {{(pid=72496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:54:17 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:54:17 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-d3db889f-0c39-45bb-bf4d-7f78a73f090a tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.678923 Apr 12 00:54:17 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 323/964] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:54:16 2023] POST /compute/v2.1/servers => generated 378 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:54:17 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-b5530b35-8397-4e74-a76a-b5e3a5aa3e30 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:54:17 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-b5530b35-8397-4e74-a76a-b5e3a5aa3e30 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:54:17 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-b5530b35-8397-4e74-a76a-b5e3a5aa3e30 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845fc21f48594cb28ac9c770612a1830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c3f0ad11ac49aaaec0a9c1827ddadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:54:17 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-b5530b35-8397-4e74-a76a-b5e3a5aa3e30 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33296a29-1e67-414b-b7d7-fa06e688b240" status: 200 len: 1208 microversion: 2.1 time: 0.073555 Apr 12 00:54:17 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 323/965] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:54:17 2023] GET /compute/v2.1/servers/33296a29-1e67-414b-b7d7-fa06e688b240 => generated 1208 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:54:20 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:20 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=10 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:20 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-728ca8ba-5e50-453d-a2e5-c4ccefdea1e8 req-e301351e-8e0d-4dfd-bebb-3599bb1fc85f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33296a29-1e67-414b-b7d7-fa06e688b240", "tag": "afefdc63-0a38-4e64-aad6-60392cbd518f"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:54:20 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-728ca8ba-5e50-453d-a2e5-c4ccefdea1e8 req-e301351e-8e0d-4dfd-bebb-3599bb1fc85f service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:20 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-728ca8ba-5e50-453d-a2e5-c4ccefdea1e8 req-e301351e-8e0d-4dfd-bebb-3599bb1fc85f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:20 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-728ca8ba-5e50-453d-a2e5-c4ccefdea1e8 req-e301351e-8e0d-4dfd-bebb-3599bb1fc85f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:20 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-728ca8ba-5e50-453d-a2e5-c4ccefdea1e8 req-e301351e-8e0d-4dfd-bebb-3599bb1fc85f service nova] Creating event network-changed:afefdc63-0a38-4e64-aad6-60392cbd518f for instance 33296a29-1e67-414b-b7d7-fa06e688b240 on user Apr 12 00:54:20 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-728ca8ba-5e50-453d-a2e5-c4ccefdea1e8 req-e301351e-8e0d-4dfd-bebb-3599bb1fc85f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036379 Apr 12 00:54:20 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 320/966] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:54:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:54:22 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-9b14b09a-f1bd-4e7e-97c5-d7c5ff4aa95a req-c33b2139-1d1e-4c1d-976b-17d685d1da95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33296a29-1e67-414b-b7d7-fa06e688b240", "name": "network-vif-plugged", "status": "completed", "tag": "afefdc63-0a38-4e64-aad6-60392cbd518f"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:54:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-9b14b09a-f1bd-4e7e-97c5-d7c5ff4aa95a req-c33b2139-1d1e-4c1d-976b-17d685d1da95 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-9b14b09a-f1bd-4e7e-97c5-d7c5ff4aa95a req-c33b2139-1d1e-4c1d-976b-17d685d1da95 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-9b14b09a-f1bd-4e7e-97c5-d7c5ff4aa95a req-c33b2139-1d1e-4c1d-976b-17d685d1da95 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:22 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-9b14b09a-f1bd-4e7e-97c5-d7c5ff4aa95a req-c33b2139-1d1e-4c1d-976b-17d685d1da95 service nova] Creating event network-vif-plugged:afefdc63-0a38-4e64-aad6-60392cbd518f for instance 33296a29-1e67-414b-b7d7-fa06e688b240 on user Apr 12 00:54:22 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-9b14b09a-f1bd-4e7e-97c5-d7c5ff4aa95a req-c33b2139-1d1e-4c1d-976b-17d685d1da95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046388 Apr 12 00:54:22 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 324/967] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:54:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:54:24 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-917c16b6-b15b-4f55-9e7a-a3e860f17025 req-7e6d6df2-0163-4ce1-8b1d-423ad8bf5afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33296a29-1e67-414b-b7d7-fa06e688b240", "name": "network-vif-plugged", "status": "completed", "tag": "afefdc63-0a38-4e64-aad6-60392cbd518f"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:54:24 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-917c16b6-b15b-4f55-9e7a-a3e860f17025 req-7e6d6df2-0163-4ce1-8b1d-423ad8bf5afd service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-917c16b6-b15b-4f55-9e7a-a3e860f17025 req-7e6d6df2-0163-4ce1-8b1d-423ad8bf5afd service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:24 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-917c16b6-b15b-4f55-9e7a-a3e860f17025 req-7e6d6df2-0163-4ce1-8b1d-423ad8bf5afd service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:24 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-917c16b6-b15b-4f55-9e7a-a3e860f17025 req-7e6d6df2-0163-4ce1-8b1d-423ad8bf5afd service nova] Creating event network-vif-plugged:afefdc63-0a38-4e64-aad6-60392cbd518f for instance 33296a29-1e67-414b-b7d7-fa06e688b240 on user Apr 12 00:54:24 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-917c16b6-b15b-4f55-9e7a-a3e860f17025 req-7e6d6df2-0163-4ce1-8b1d-423ad8bf5afd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045773 Apr 12 00:54:24 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 324/968] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:54:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:54:29 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-b43bdc36-4612-48c1-adc8-2c77ad2f0318 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:54:29 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-b43bdc36-4612-48c1-adc8-2c77ad2f0318 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: 84861eef-6d59-448b-b6b7-eb8dd8e47b30] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:54:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b43bdc36-4612-48c1-adc8-2c77ad2f0318 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b43bdc36-4612-48c1-adc8-2c77ad2f0318 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b43bdc36-4612-48c1-adc8-2c77ad2f0318 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b43bdc36-4612-48c1-adc8-2c77ad2f0318 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b43bdc36-4612-48c1-adc8-2c77ad2f0318 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b43bdc36-4612-48c1-adc8-2c77ad2f0318 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:29 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-b43bdc36-4612-48c1-adc8-2c77ad2f0318 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] HTTP exception thrown: Instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30 could not be found. Apr 12 00:54:29 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-b43bdc36-4612-48c1-adc8-2c77ad2f0318 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Request method failure captured: Apr 12 00:54:29 user devstack@n-api.service[72495]: request: GET /compute/v2.1/servers/84861eef-6d59-448b-b6b7-eb8dd8e47b30 HTTP/1.1 Apr 12 00:54:29 user devstack@n-api.service[72495]: Accept: application/json Apr 12 00:54:29 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 00:54:29 user devstack@n-api.service[72495]: Connection: close Apr 12 00:54:29 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 00:54:29 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 00:54:29 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 00:54:29 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 00:54:29 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 00:54:29 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNft8pxUfRov3VWMJsz3neTVP7vjPZrPoG_D_RpQWIM-EEGVf8w5xREov2D3rG8pVUGFFc4iIpAW0aRk2Z5TmADpnstC41AikbDOkY4nppdui0mYCGWq3s8swIvjZVz3SyGIqiVTX7Hr0WxRb2aVDp1_7Es2G3Qsunn_AD4oFLvHyF9g Apr 12 00:54:29 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 00:54:29 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 00:54:29 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 00:54:29 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 00:54:29 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 00:54:29 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 00:54:29 user devstack@n-api.service[72495]: X-Project-Id: d8ba626fdf264b879099a89097845153 Apr 12 00:54:29 user devstack@n-api.service[72495]: X-Project-Name: tempest-ServerActionsTestJSON-674156571 Apr 12 00:54:29 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 00:54:29 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 00:54:29 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8ba626fdf264b879099a89097845153"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d8ba626fdf264b879099a89097845153"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8ba626fdf264b879099a89097845153"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:54:29 user devstack@n-api.service[72495]: X-Tenant: tempest-ServerActionsTestJSON-674156571 Apr 12 00:54:29 user devstack@n-api.service[72495]: X-Tenant-Id: d8ba626fdf264b879099a89097845153 Apr 12 00:54:29 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-ServerActionsTestJSON-674156571 Apr 12 00:54:29 user devstack@n-api.service[72495]: X-User: tempest-ServerActionsTestJSON-674156571-project-member Apr 12 00:54:29 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 00:54:29 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 00:54:29 user devstack@n-api.service[72495]: X-User-Id: d658147b4def4d12a16381d4c19357e3 Apr 12 00:54:29 user devstack@n-api.service[72495]: X-User-Name: tempest-ServerActionsTestJSON-674156571-project-member Apr 12 00:54:29 user devstack@n-api.service[72495]: method: > Apr 12 00:54:29 user devstack@n-api.service[72495]: exception: Instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30 could not be found. Apr 12 00:54:29 user devstack@n-api.service[72495]: action_args: {'id': '84861eef-6d59-448b-b6b7-eb8dd8e47b30'} Apr 12 00:54:29 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30 could not be found. Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30 could not be found. Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30 could not be found. Apr 12 00:54:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 00:54:29 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-b43bdc36-4612-48c1-adc8-2c77ad2f0318 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Returning 404 to user: Instance 84861eef-6d59-448b-b6b7-eb8dd8e47b30 could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:54:29 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-b43bdc36-4612-48c1-adc8-2c77ad2f0318 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84861eef-6d59-448b-b6b7-eb8dd8e47b30" status: 404 len: 111 microversion: 2.1 time: 0.033192 Apr 12 00:54:29 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 321/969] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:54:29 2023] GET /compute/v2.1/servers/84861eef-6d59-448b-b6b7-eb8dd8e47b30 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:54:34 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-15b54af0-7bac-4319-af15-f9a48ae84b39 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:54:34 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-15b54af0-7bac-4319-af15-f9a48ae84b39 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:54:34 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:34 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:34 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:34 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:34 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-15b54af0-7bac-4319-af15-f9a48ae84b39 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:34 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-15b54af0-7bac-4319-af15-f9a48ae84b39 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:34 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-15b54af0-7bac-4319-af15-f9a48ae84b39 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:34 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-15b54af0-7bac-4319-af15-f9a48ae84b39 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:34 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-15b54af0-7bac-4319-af15-f9a48ae84b39 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:34 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-15b54af0-7bac-4319-af15-f9a48ae84b39 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:34 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-15b54af0-7bac-4319-af15-f9a48ae84b39 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] HTTP exception thrown: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:54:34 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-15b54af0-7bac-4319-af15-f9a48ae84b39 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Request method failure captured: Apr 12 00:54:34 user devstack@n-api.service[72496]: request: DELETE /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 HTTP/1.1 Apr 12 00:54:34 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:54:34 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:54:34 user devstack@n-api.service[72496]: Connection: close Apr 12 00:54:34 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:54:34 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:54:34 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:54:34 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:54:34 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:54:34 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNft8pxUfRov3VWMJsz3neTVP7vjPZrPoG_D_RpQWIM-EEGVf8w5xREov2D3rG8pVUGFFc4iIpAW0aRk2Z5TmADpnstC41AikbDOkY4nppdui0mYCGWq3s8swIvjZVz3SyGIqiVTX7Hr0WxRb2aVDp1_7Es2G3Qsunn_AD4oFLvHyF9g Apr 12 00:54:34 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:54:34 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:54:34 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:54:34 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:54:34 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:54:34 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:54:34 user devstack@n-api.service[72496]: X-Project-Id: d8ba626fdf264b879099a89097845153 Apr 12 00:54:34 user devstack@n-api.service[72496]: X-Project-Name: tempest-ServerActionsTestJSON-674156571 Apr 12 00:54:34 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:54:34 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:54:34 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8ba626fdf264b879099a89097845153"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d8ba626fdf264b879099a89097845153"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8ba626fdf264b879099a89097845153"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:54:34 user devstack@n-api.service[72496]: X-Tenant: tempest-ServerActionsTestJSON-674156571 Apr 12 00:54:34 user devstack@n-api.service[72496]: X-Tenant-Id: d8ba626fdf264b879099a89097845153 Apr 12 00:54:34 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-ServerActionsTestJSON-674156571 Apr 12 00:54:34 user devstack@n-api.service[72496]: X-User: tempest-ServerActionsTestJSON-674156571-project-member Apr 12 00:54:34 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:54:34 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:54:34 user devstack@n-api.service[72496]: X-User-Id: d658147b4def4d12a16381d4c19357e3 Apr 12 00:54:34 user devstack@n-api.service[72496]: X-User-Name: tempest-ServerActionsTestJSON-674156571-project-member Apr 12 00:54:34 user devstack@n-api.service[72496]: method: > Apr 12 00:54:34 user devstack@n-api.service[72496]: exception: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:54:34 user devstack@n-api.service[72496]: action_args: {'id': 'dbe6d6bc-65a6-469a-89a0-7e4c51620b14'} Apr 12 00:54:34 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:54:34 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:54:34 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-15b54af0-7bac-4319-af15-f9a48ae84b39 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Returning 404 to user: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:54:34 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-15b54af0-7bac-4319-af15-f9a48ae84b39 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 404 len: 111 microversion: 2.1 time: 0.048343 Apr 12 00:54:34 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 325/970] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:54:34 2023] DELETE /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:54:34 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:34 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-921c0958-057f-4c0f-bf61-9a4a6a38ded8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:54:34 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-921c0958-057f-4c0f-bf61-9a4a6a38ded8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] [instance: dbe6d6bc-65a6-469a-89a0-7e4c51620b14] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:54:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-921c0958-057f-4c0f-bf61-9a4a6a38ded8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-921c0958-057f-4c0f-bf61-9a4a6a38ded8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-921c0958-057f-4c0f-bf61-9a4a6a38ded8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-921c0958-057f-4c0f-bf61-9a4a6a38ded8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-921c0958-057f-4c0f-bf61-9a4a6a38ded8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:34 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-921c0958-057f-4c0f-bf61-9a4a6a38ded8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:34 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-921c0958-057f-4c0f-bf61-9a4a6a38ded8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] HTTP exception thrown: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:54:34 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-921c0958-057f-4c0f-bf61-9a4a6a38ded8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Request method failure captured: Apr 12 00:54:34 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 HTTP/1.1 Apr 12 00:54:34 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:54:34 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:54:34 user devstack@n-api.service[72494]: Connection: close Apr 12 00:54:34 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:54:34 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:54:34 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:54:34 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:54:34 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:54:34 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNft8pxUfRov3VWMJsz3neTVP7vjPZrPoG_D_RpQWIM-EEGVf8w5xREov2D3rG8pVUGFFc4iIpAW0aRk2Z5TmADpnstC41AikbDOkY4nppdui0mYCGWq3s8swIvjZVz3SyGIqiVTX7Hr0WxRb2aVDp1_7Es2G3Qsunn_AD4oFLvHyF9g Apr 12 00:54:34 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:54:34 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:54:34 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:54:34 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:54:34 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:54:34 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:54:34 user devstack@n-api.service[72494]: X-Project-Id: d8ba626fdf264b879099a89097845153 Apr 12 00:54:34 user devstack@n-api.service[72494]: X-Project-Name: tempest-ServerActionsTestJSON-674156571 Apr 12 00:54:34 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:54:34 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:54:34 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8ba626fdf264b879099a89097845153"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d8ba626fdf264b879099a89097845153"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d8ba626fdf264b879099a89097845153"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:54:34 user devstack@n-api.service[72494]: X-Tenant: tempest-ServerActionsTestJSON-674156571 Apr 12 00:54:34 user devstack@n-api.service[72494]: X-Tenant-Id: d8ba626fdf264b879099a89097845153 Apr 12 00:54:34 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-ServerActionsTestJSON-674156571 Apr 12 00:54:34 user devstack@n-api.service[72494]: X-User: tempest-ServerActionsTestJSON-674156571-project-member Apr 12 00:54:34 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:54:34 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:54:34 user devstack@n-api.service[72494]: X-User-Id: d658147b4def4d12a16381d4c19357e3 Apr 12 00:54:34 user devstack@n-api.service[72494]: X-User-Name: tempest-ServerActionsTestJSON-674156571-project-member Apr 12 00:54:34 user devstack@n-api.service[72494]: method: > Apr 12 00:54:34 user devstack@n-api.service[72494]: exception: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:54:34 user devstack@n-api.service[72494]: action_args: {'id': 'dbe6d6bc-65a6-469a-89a0-7e4c51620b14'} Apr 12 00:54:34 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. Apr 12 00:54:34 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:54:34 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-921c0958-057f-4c0f-bf61-9a4a6a38ded8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Returning 404 to user: Instance dbe6d6bc-65a6-469a-89a0-7e4c51620b14 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:54:34 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-921c0958-057f-4c0f-bf61-9a4a6a38ded8 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14" status: 404 len: 111 microversion: 2.1 time: 0.038604 Apr 12 00:54:34 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 325/971] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:54:34 2023] GET /compute/v2.1/servers/dbe6d6bc-65a6-469a-89a0-7e4c51620b14 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:54:34 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-b2d9501f-e292-4a80-b4c7-2a960bd0b5f0 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] Calling method '.version_select at 0x7f7cd45b5bd0>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:54:34 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-b2d9501f-e292-4a80-b4c7-2a960bd0b5f0 tempest-ServerActionsTestJSON-674156571 tempest-ServerActionsTestJSON-674156571-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1452487550" status: 202 len: 0 microversion: 2.1 time: 0.024422 Apr 12 00:54:34 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 322/972] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 00:54:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1452487550 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 00:54:45 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:45 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:45 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-c5fcb697-1c8c-47ec-97e4-68ccee333ed5 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Action: 'create', calling method: .version_select at 0x7f7cd4673d90>, body: {"keypair": {"name": "tempest-keypair-1824777377", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhkaYM4bzvKjlt+XK6hYKnU1Ed3vc/iv6lwsUyEh5UkHRise/0nAsGorrCmpbbpHQeoABf4SqJ+7Cj498V+6EsSu4dT7jtupY55U8ehZ3W+FlZGOucajkyX4bNIKLwnWQ=="}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:54:45 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-c5fcb697-1c8c-47ec-97e4-68ccee333ed5 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Getting quotas for project 21ca08eae6134a639c5f532e0742b3a2. Resources: {'key_pairs'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:54:45 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-c5fcb697-1c8c-47ec-97e4-68ccee333ed5 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Getting quotas for user 7aedb8da82a64bdcaeff07c649f05379 and project 21ca08eae6134a639c5f532e0742b3a2. Resources: {'key_pairs'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:54:45 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-c5fcb697-1c8c-47ec-97e4-68ccee333ed5 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.167935 Apr 12 00:54:45 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 326/973] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 00:54:45 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:54:46 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-610910613", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "networks": [{"uuid": "55f94ec9-8867-4883-ab9d-8a6dc2581156"}], "security_groups": [{"name": "tempest-securitygroup--1899815041"}], "key_name": "tempest-keypair-1824777377", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:54:46 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:46 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=4 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:46 user devstack@n-api.service[72494]: DEBUG nova.network.neutron [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] validate_networks() for [('55f94ec9-8867-4883-ab9d-8a6dc2581156', None, None, None, None, None)] {{(pid=72494) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:54:47 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Flavor limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:54:47 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Image limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:54:47 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Flavor pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:54:47 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Image pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:54:47 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:54:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:47 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Getting quotas for project 21ca08eae6134a639c5f532e0742b3a2. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:54:47 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Getting quotas for user 7aedb8da82a64bdcaeff07c649f05379 and project 21ca08eae6134a639c5f532e0742b3a2. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:54:47 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Going to run 1 instances... {{(pid=72494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:54:47 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:54:47 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-04bdc8d6-1d7b-47e9-b5fa-175f9f067b98 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.618866 Apr 12 00:54:47 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 326/974] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:54:46 2023] POST /compute/v2.1/servers => generated 404 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:54:47 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:47 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:47 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-2474fa89-437b-4416-ba8a-84853a765e3a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:54:47 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-2474fa89-437b-4416-ba8a-84853a765e3a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:54:47 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-2474fa89-437b-4416-ba8a-84853a765e3a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aedb8da82a64bdcaeff07c649f05379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ca08eae6134a639c5f532e0742b3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:54:47 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-2474fa89-437b-4416-ba8a-84853a765e3a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db" status: 200 len: 1239 microversion: 2.1 time: 0.069369 Apr 12 00:54:47 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 323/975] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:54:47 2023] GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:54:49 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-e76ba1d5-53b6-4798-8da0-4deb3fefd97f req-1965be50-c605-46fe-8942-ab6b656ccb4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a67c354-55e9-4f42-bda3-35d16bf192db", "tag": "d04a1887-8740-4c6c-a7b6-5e9e395ced98"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:54:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-e76ba1d5-53b6-4798-8da0-4deb3fefd97f req-1965be50-c605-46fe-8942-ab6b656ccb4e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-e76ba1d5-53b6-4798-8da0-4deb3fefd97f req-1965be50-c605-46fe-8942-ab6b656ccb4e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-e76ba1d5-53b6-4798-8da0-4deb3fefd97f req-1965be50-c605-46fe-8942-ab6b656ccb4e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:49 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-e76ba1d5-53b6-4798-8da0-4deb3fefd97f req-1965be50-c605-46fe-8942-ab6b656ccb4e service nova] Creating event network-changed:d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance 4a67c354-55e9-4f42-bda3-35d16bf192db on user Apr 12 00:54:49 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-e76ba1d5-53b6-4798-8da0-4deb3fefd97f req-1965be50-c605-46fe-8942-ab6b656ccb4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056535 Apr 12 00:54:49 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 327/976] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:54:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:54:51 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-8907278a-c61e-4e30-8cb2-3d9fb419da38 req-ab0633a8-3438-4b78-b9f7-98c79541af6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a67c354-55e9-4f42-bda3-35d16bf192db", "name": "network-vif-plugged", "status": "completed", "tag": "d04a1887-8740-4c6c-a7b6-5e9e395ced98"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:54:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-8907278a-c61e-4e30-8cb2-3d9fb419da38 req-ab0633a8-3438-4b78-b9f7-98c79541af6c service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-8907278a-c61e-4e30-8cb2-3d9fb419da38 req-ab0633a8-3438-4b78-b9f7-98c79541af6c service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-8907278a-c61e-4e30-8cb2-3d9fb419da38 req-ab0633a8-3438-4b78-b9f7-98c79541af6c service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:51 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-8907278a-c61e-4e30-8cb2-3d9fb419da38 req-ab0633a8-3438-4b78-b9f7-98c79541af6c service nova] Creating event network-vif-plugged:d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance 4a67c354-55e9-4f42-bda3-35d16bf192db on user Apr 12 00:54:51 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-8907278a-c61e-4e30-8cb2-3d9fb419da38 req-ab0633a8-3438-4b78-b9f7-98c79541af6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037935 Apr 12 00:54:51 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 327/977] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:54:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:54:53 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-98b5742c-ed3f-472f-b4e0-d022d21f0359 req-bf1e1b56-fc79-4a62-af6c-36879c020e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a67c354-55e9-4f42-bda3-35d16bf192db", "name": "network-vif-plugged", "status": "completed", "tag": "d04a1887-8740-4c6c-a7b6-5e9e395ced98"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:54:53 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-98b5742c-ed3f-472f-b4e0-d022d21f0359 req-bf1e1b56-fc79-4a62-af6c-36879c020e10 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:53 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-98b5742c-ed3f-472f-b4e0-d022d21f0359 req-bf1e1b56-fc79-4a62-af6c-36879c020e10 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:53 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-98b5742c-ed3f-472f-b4e0-d022d21f0359 req-bf1e1b56-fc79-4a62-af6c-36879c020e10 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:53 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-98b5742c-ed3f-472f-b4e0-d022d21f0359 req-bf1e1b56-fc79-4a62-af6c-36879c020e10 service nova] Creating event network-vif-plugged:d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance 4a67c354-55e9-4f42-bda3-35d16bf192db on user Apr 12 00:54:53 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-98b5742c-ed3f-472f-b4e0-d022d21f0359 req-bf1e1b56-fc79-4a62-af6c-36879c020e10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032053 Apr 12 00:54:53 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 324/978] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:54:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:54:56 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-0b170cf1-71e2-4ff2-9c2c-7bb9ad0d8e01 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:54:56 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-0b170cf1-71e2-4ff2-9c2c-7bb9ad0d8e01 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:54:56 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:56 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0b170cf1-71e2-4ff2-9c2c-7bb9ad0d8e01 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:56 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0b170cf1-71e2-4ff2-9c2c-7bb9ad0d8e01 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:56 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0b170cf1-71e2-4ff2-9c2c-7bb9ad0d8e01 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:56 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0b170cf1-71e2-4ff2-9c2c-7bb9ad0d8e01 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:56 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0b170cf1-71e2-4ff2-9c2c-7bb9ad0d8e01 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:56 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0b170cf1-71e2-4ff2-9c2c-7bb9ad0d8e01 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:56 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-0b170cf1-71e2-4ff2-9c2c-7bb9ad0d8e01 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] HTTP exception thrown: Instance a4d163ed-7900-486c-8b96-101af5547580 could not be found. Apr 12 00:54:56 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-0b170cf1-71e2-4ff2-9c2c-7bb9ad0d8e01 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Request method failure captured: Apr 12 00:54:56 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580 HTTP/1.1 Apr 12 00:54:56 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:54:56 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:54:56 user devstack@n-api.service[72496]: Connection: close Apr 12 00:54:56 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:54:56 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:54:56 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:54:56 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:54:56 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:54:56 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNf-p5DHRzBNEyPvYkog6l4TYa8AiCIwFog1dykK5sKE0WJHvnMKjDSCkB5GSFSZs7AGZw0tRcc0GWzrFvhUcvgsOl7nkaoOc9K_SLD82QLyBIk61yigh2Eu4LWHDM-AmZJIuxIDL7rGcXsWkew6ZWa4nXxT648elHnjoZNRIC08lD2U Apr 12 00:54:56 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:54:56 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:54:56 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:54:56 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:54:56 user devstack@n-api.service[72496]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 00:54:56 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:54:56 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:54:56 user devstack@n-api.service[72496]: X-Project-Id: c26d891933d647b7b27c75915fb726f3 Apr 12 00:54:56 user devstack@n-api.service[72496]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1335687803 Apr 12 00:54:56 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:54:56 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:54:56 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c26d891933d647b7b27c75915fb726f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c26d891933d647b7b27c75915fb726f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c26d891933d647b7b27c75915fb726f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:54:56 user devstack@n-api.service[72496]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1335687803 Apr 12 00:54:56 user devstack@n-api.service[72496]: X-Tenant-Id: c26d891933d647b7b27c75915fb726f3 Apr 12 00:54:56 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1335687803 Apr 12 00:54:56 user devstack@n-api.service[72496]: X-User: tempest-AttachVolumeShelveTestJSON-1335687803-project-member Apr 12 00:54:56 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:54:56 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:54:56 user devstack@n-api.service[72496]: X-User-Id: 418881a7e56e4c19bbf900ef71029ce0 Apr 12 00:54:56 user devstack@n-api.service[72496]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1335687803-project-member Apr 12 00:54:56 user devstack@n-api.service[72496]: method: > Apr 12 00:54:56 user devstack@n-api.service[72496]: exception: Instance a4d163ed-7900-486c-8b96-101af5547580 could not be found. Apr 12 00:54:56 user devstack@n-api.service[72496]: action_args: {'id': 'a4d163ed-7900-486c-8b96-101af5547580'} Apr 12 00:54:56 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4d163ed-7900-486c-8b96-101af5547580 could not be found. Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4d163ed-7900-486c-8b96-101af5547580 could not be found. Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4d163ed-7900-486c-8b96-101af5547580 could not be found. Apr 12 00:54:56 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:54:56 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-0b170cf1-71e2-4ff2-9c2c-7bb9ad0d8e01 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Returning 404 to user: Instance a4d163ed-7900-486c-8b96-101af5547580 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:54:56 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-0b170cf1-71e2-4ff2-9c2c-7bb9ad0d8e01 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580" status: 404 len: 111 microversion: 2.20 time: 0.032063 Apr 12 00:54:56 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 328/979] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:54:56 2023] GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 00:54:56 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-2b648ad7-a90e-4658-94f9-fbc0174b9c28 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '.version_select at 0x7f7cd461a830>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:54:56 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-2b648ad7-a90e-4658-94f9-fbc0174b9c28 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1276421029" status: 204 len: 0 microversion: 2.20 time: 0.021642 Apr 12 00:54:56 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 328/980] 10.0.0.210 () {64 vars in 1339 bytes} [Wed Apr 12 00:54:56 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1276421029 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 00:54:57 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-5329254a-2ec6-4df0-a0fe-581e554dc855 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Action: 'create', calling method: .version_select at 0x7f7cd45b6a70>, body: {"keypair": {"name": "tempest-keypair-238651399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3Wdo8lz+ZAHRli9jiADK4Sk7Y/NTuUS3pMEJzsy5L3/rQRehuzFZ0WTvUKDg92fAHcsMVP1vVTwrU696XzeqdiIx5fwn9f1xYz3ikBKgpnr3tCLjlykBzcNLc0GQnnbg=="}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:54:57 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-5329254a-2ec6-4df0-a0fe-581e554dc855 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Getting quotas for project c26d891933d647b7b27c75915fb726f3. Resources: {'key_pairs'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:54:57 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-5329254a-2ec6-4df0-a0fe-581e554dc855 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Getting quotas for user 418881a7e56e4c19bbf900ef71029ce0 and project c26d891933d647b7b27c75915fb726f3. Resources: {'key_pairs'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:54:57 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-5329254a-2ec6-4df0-a0fe-581e554dc855 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.047538 Apr 12 00:54:57 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 325/981] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 00:54:57 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 00:54:59 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1629541624", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "7ecd3c10-773d-4651-a82d-42b4aaad386f"}], "security_groups": [{"name": "tempest-securitygroup--1119176878"}], "key_name": "tempest-keypair-238651399", "user_data": "}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:54:59 user devstack@n-api.service[72496]: DEBUG nova.network.neutron [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] validate_networks() for [('7ecd3c10-773d-4651-a82d-42b4aaad386f', None, None, None, None, None)] {{(pid=72496) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:54:59 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Flavor limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:54:59 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Image limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:54:59 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Flavor pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:54:59 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Image pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:54:59 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:54:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:54:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:54:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:54:59 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Getting quotas for project c26d891933d647b7b27c75915fb726f3. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:54:59 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Getting quotas for user 418881a7e56e4c19bbf900ef71029ce0 and project c26d891933d647b7b27c75915fb726f3. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:54:59 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Going to run 1 instances... {{(pid=72496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:54:59 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:54:59 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-78507b22-31fd-470c-a7bf-8770827ab393 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.517197 Apr 12 00:54:59 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 329/982] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 00:54:59 2023] POST /compute/v2.1/servers => generated 400 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 00:54:59 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:59 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=6 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:54:59 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-18237585-a209-40c1-a39f-dc40194f5012 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:54:59 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-18237585-a209-40c1-a39f-dc40194f5012 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:54:59 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-18237585-a209-40c1-a39f-dc40194f5012 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:54:59 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-18237585-a209-40c1-a39f-dc40194f5012 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:54:59 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-18237585-a209-40c1-a39f-dc40194f5012 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:54:59 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-18237585-a209-40c1-a39f-dc40194f5012 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608" status: 200 len: 1275 microversion: 2.20 time: 0.070395 Apr 12 00:54:59 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 329/983] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:54:59 2023] GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608 => generated 1275 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:55:01 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-9d845600-db22-4dbc-aa7d-25b948683460 req-beed2676-03fa-4ba7-a939-93012d1cac54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e24bbae-7697-4c46-9c68-48d8393da608", "tag": "6c9e7810-9a63-4360-889c-edbd6af6ba4f"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:55:01 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-9d845600-db22-4dbc-aa7d-25b948683460 req-beed2676-03fa-4ba7-a939-93012d1cac54 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:55:01 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-9d845600-db22-4dbc-aa7d-25b948683460 req-beed2676-03fa-4ba7-a939-93012d1cac54 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:55:01 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-9d845600-db22-4dbc-aa7d-25b948683460 req-beed2676-03fa-4ba7-a939-93012d1cac54 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:55:01 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-9d845600-db22-4dbc-aa7d-25b948683460 req-beed2676-03fa-4ba7-a939-93012d1cac54 service nova] Creating event network-changed:6c9e7810-9a63-4360-889c-edbd6af6ba4f for instance 4e24bbae-7697-4c46-9c68-48d8393da608 on user Apr 12 00:55:01 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-9d845600-db22-4dbc-aa7d-25b948683460 req-beed2676-03fa-4ba7-a939-93012d1cac54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038198 Apr 12 00:55:01 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 326/984] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:55:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:55:03 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-16682014-feea-4e72-8560-7f05f7fd74ca req-3da351f1-7f7d-41bc-b64b-e9d7ec2f3ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e24bbae-7697-4c46-9c68-48d8393da608", "name": "network-vif-plugged", "status": "completed", "tag": "6c9e7810-9a63-4360-889c-edbd6af6ba4f"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:55:03 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-16682014-feea-4e72-8560-7f05f7fd74ca req-3da351f1-7f7d-41bc-b64b-e9d7ec2f3ba7 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:55:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-16682014-feea-4e72-8560-7f05f7fd74ca req-3da351f1-7f7d-41bc-b64b-e9d7ec2f3ba7 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:55:04 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-16682014-feea-4e72-8560-7f05f7fd74ca req-3da351f1-7f7d-41bc-b64b-e9d7ec2f3ba7 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:55:04 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-16682014-feea-4e72-8560-7f05f7fd74ca req-3da351f1-7f7d-41bc-b64b-e9d7ec2f3ba7 service nova] Creating event network-vif-plugged:6c9e7810-9a63-4360-889c-edbd6af6ba4f for instance 4e24bbae-7697-4c46-9c68-48d8393da608 on user Apr 12 00:55:04 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-16682014-feea-4e72-8560-7f05f7fd74ca req-3da351f1-7f7d-41bc-b64b-e9d7ec2f3ba7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038779 Apr 12 00:55:04 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 330/985] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:55:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:55:06 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-f37a110b-9e20-40ca-8051-f707dcd07501 req-77cd208e-239a-417b-8471-782c16bc936a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e24bbae-7697-4c46-9c68-48d8393da608", "name": "network-vif-plugged", "status": "completed", "tag": "6c9e7810-9a63-4360-889c-edbd6af6ba4f"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:55:06 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=4 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:55:06 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f37a110b-9e20-40ca-8051-f707dcd07501 req-77cd208e-239a-417b-8471-782c16bc936a service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:55:06 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f37a110b-9e20-40ca-8051-f707dcd07501 req-77cd208e-239a-417b-8471-782c16bc936a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:55:06 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f37a110b-9e20-40ca-8051-f707dcd07501 req-77cd208e-239a-417b-8471-782c16bc936a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:55:06 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-f37a110b-9e20-40ca-8051-f707dcd07501 req-77cd208e-239a-417b-8471-782c16bc936a service nova] Creating event network-vif-plugged:6c9e7810-9a63-4360-889c-edbd6af6ba4f for instance 4e24bbae-7697-4c46-9c68-48d8393da608 on user Apr 12 00:55:06 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-f37a110b-9e20-40ca-8051-f707dcd07501 req-77cd208e-239a-417b-8471-782c16bc936a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037755 Apr 12 00:55:06 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 330/986] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:55:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:55:07 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:55:07 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-2db680e1-b2af-457b-aee1-4519e6059343 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:55:07 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-2db680e1-b2af-457b-aee1-4519e6059343 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:55:07 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2db680e1-b2af-457b-aee1-4519e6059343 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:55:07 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2db680e1-b2af-457b-aee1-4519e6059343 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:55:07 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2db680e1-b2af-457b-aee1-4519e6059343 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:55:07 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2db680e1-b2af-457b-aee1-4519e6059343 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:55:07 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2db680e1-b2af-457b-aee1-4519e6059343 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:55:07 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2db680e1-b2af-457b-aee1-4519e6059343 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:55:07 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-2db680e1-b2af-457b-aee1-4519e6059343 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845fc21f48594cb28ac9c770612a1830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c3f0ad11ac49aaaec0a9c1827ddadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:55:07 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-2db680e1-b2af-457b-aee1-4519e6059343 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33296a29-1e67-414b-b7d7-fa06e688b240" status: 200 len: 1485 microversion: 2.1 time: 0.152943 Apr 12 00:55:07 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 327/987] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:55:07 2023] GET /compute/v2.1/servers/33296a29-1e67-414b-b7d7-fa06e688b240 => generated 1485 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:55:37 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:55:37 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:55:37 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:55:37 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=8 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:55:37 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-6e68610e-f60a-4d63-92b4-ffe41e5cff85 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:55:37 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-6e68610e-f60a-4d63-92b4-ffe41e5cff85 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:55:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6e68610e-f60a-4d63-92b4-ffe41e5cff85 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:55:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6e68610e-f60a-4d63-92b4-ffe41e5cff85 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:55:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6e68610e-f60a-4d63-92b4-ffe41e5cff85 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:55:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6e68610e-f60a-4d63-92b4-ffe41e5cff85 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:55:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6e68610e-f60a-4d63-92b4-ffe41e5cff85 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:55:37 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-6e68610e-f60a-4d63-92b4-ffe41e5cff85 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:55:37 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-6e68610e-f60a-4d63-92b4-ffe41e5cff85 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aedb8da82a64bdcaeff07c649f05379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ca08eae6134a639c5f532e0742b3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:55:37 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-6e68610e-f60a-4d63-92b4-ffe41e5cff85 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db" status: 200 len: 1553 microversion: 2.1 time: 0.209976 Apr 12 00:55:37 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 331/988] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:55:37 2023] GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db => generated 1553 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:55:49 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:55:49 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:55:49 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:55:49 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-0ec22335-5310-4912-bfc6-335a44449e3d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:55:49 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-0ec22335-5310-4912-bfc6-335a44449e3d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:55:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0ec22335-5310-4912-bfc6-335a44449e3d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:55:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0ec22335-5310-4912-bfc6-335a44449e3d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:55:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0ec22335-5310-4912-bfc6-335a44449e3d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:55:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0ec22335-5310-4912-bfc6-335a44449e3d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:55:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0ec22335-5310-4912-bfc6-335a44449e3d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:55:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0ec22335-5310-4912-bfc6-335a44449e3d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:55:49 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-0ec22335-5310-4912-bfc6-335a44449e3d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:55:49 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-0ec22335-5310-4912-bfc6-335a44449e3d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:55:49 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-0ec22335-5310-4912-bfc6-335a44449e3d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:55:49 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-0ec22335-5310-4912-bfc6-335a44449e3d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608" status: 200 len: 1588 microversion: 2.20 time: 0.206374 Apr 12 00:55:49 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 331/989] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:55:49 2023] GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608 => generated 1588 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:56:08 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:56:08 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=10 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:56:08 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:56:08 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:56:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:08 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:08 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Going to try to terminate instance {{(pid=72495) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:56:08 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-90c99f31-3dc7-480f-abe2-eb7a832c2a5d tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/33296a29-1e67-414b-b7d7-fa06e688b240" status: 204 len: 0 microversion: 2.1 time: 0.230288 Apr 12 00:56:08 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 328/990] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:56:08 2023] DELETE /compute/v2.1/servers/33296a29-1e67-414b-b7d7-fa06e688b240 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:56:08 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-0adb0d73-9f53-49fd-996b-53955d571476 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:56:08 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-0adb0d73-9f53-49fd-996b-53955d571476 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:56:08 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:56:08 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:56:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0adb0d73-9f53-49fd-996b-53955d571476 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0adb0d73-9f53-49fd-996b-53955d571476 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0adb0d73-9f53-49fd-996b-53955d571476 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0adb0d73-9f53-49fd-996b-53955d571476 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0adb0d73-9f53-49fd-996b-53955d571476 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:08 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0adb0d73-9f53-49fd-996b-53955d571476 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:08 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-0adb0d73-9f53-49fd-996b-53955d571476 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845fc21f48594cb28ac9c770612a1830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c3f0ad11ac49aaaec0a9c1827ddadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:56:08 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-0adb0d73-9f53-49fd-996b-53955d571476 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33296a29-1e67-414b-b7d7-fa06e688b240" status: 200 len: 1491 microversion: 2.1 time: 0.201937 Apr 12 00:56:08 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 332/991] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:56:08 2023] GET /compute/v2.1/servers/33296a29-1e67-414b-b7d7-fa06e688b240 => generated 1491 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:56:08 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-f405d565-e602-4839-9ee4-9f4fb7fad298 req-3529757b-f947-4c4d-8d1a-6ac80f8341f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33296a29-1e67-414b-b7d7-fa06e688b240", "name": "network-vif-unplugged", "status": "completed", "tag": "afefdc63-0a38-4e64-aad6-60392cbd518f"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:56:08 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:56:08 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=6 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:56:08 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f405d565-e602-4839-9ee4-9f4fb7fad298 req-3529757b-f947-4c4d-8d1a-6ac80f8341f3 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:08 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f405d565-e602-4839-9ee4-9f4fb7fad298 req-3529757b-f947-4c4d-8d1a-6ac80f8341f3 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:08 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f405d565-e602-4839-9ee4-9f4fb7fad298 req-3529757b-f947-4c4d-8d1a-6ac80f8341f3 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:08 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-f405d565-e602-4839-9ee4-9f4fb7fad298 req-3529757b-f947-4c4d-8d1a-6ac80f8341f3 service nova] Creating event network-vif-unplugged:afefdc63-0a38-4e64-aad6-60392cbd518f for instance 33296a29-1e67-414b-b7d7-fa06e688b240 on user Apr 12 00:56:08 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-f405d565-e602-4839-9ee4-9f4fb7fad298 req-3529757b-f947-4c4d-8d1a-6ac80f8341f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044783 Apr 12 00:56:08 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 332/992] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:56:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:56:10 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-a31e5294-1b8a-44c7-a152-2b95dce91920 req-598d8fed-967f-438a-a1c9-c19748d2cecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33296a29-1e67-414b-b7d7-fa06e688b240", "name": "network-vif-deleted", "tag": "afefdc63-0a38-4e64-aad6-60392cbd518f"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:56:10 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a31e5294-1b8a-44c7-a152-2b95dce91920 req-598d8fed-967f-438a-a1c9-c19748d2cecd service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:10 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a31e5294-1b8a-44c7-a152-2b95dce91920 req-598d8fed-967f-438a-a1c9-c19748d2cecd service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:10 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-a31e5294-1b8a-44c7-a152-2b95dce91920 req-598d8fed-967f-438a-a1c9-c19748d2cecd service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:10 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-a31e5294-1b8a-44c7-a152-2b95dce91920 req-598d8fed-967f-438a-a1c9-c19748d2cecd service nova] Creating event network-vif-deleted:afefdc63-0a38-4e64-aad6-60392cbd518f for instance 33296a29-1e67-414b-b7d7-fa06e688b240 on user Apr 12 00:56:10 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-a31e5294-1b8a-44c7-a152-2b95dce91920 req-598d8fed-967f-438a-a1c9-c19748d2cecd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044852 Apr 12 00:56:10 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 329/993] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:56:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 00:56:10 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33296a29-1e67-414b-b7d7-fa06e688b240", "name": "network-vif-plugged", "status": "completed", "tag": "afefdc63-0a38-4e64-aad6-60392cbd518f"}, {"server_uuid": "33296a29-1e67-414b-b7d7-fa06e688b240", "name": "network-vif-plugged", "status": "completed", "tag": "afefdc63-0a38-4e64-aad6-60392cbd518f"}, {"server_uuid": "33296a29-1e67-414b-b7d7-fa06e688b240", "name": "network-vif-plugged", "status": "completed", "tag": "afefdc63-0a38-4e64-aad6-60392cbd518f"}, {"server_uuid": "33296a29-1e67-414b-b7d7-fa06e688b240", "name": "network-vif-unplugged", "status": "completed", "tag": "afefdc63-0a38-4e64-aad6-60392cbd518f"}, {"server_uuid": "33296a29-1e67-414b-b7d7-fa06e688b240", "name": "network-vif-plugged", "status": "completed", "tag": "afefdc63-0a38-4e64-aad6-60392cbd518f"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:56:10 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:10 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:10 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:10 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] Creating event network-vif-plugged:afefdc63-0a38-4e64-aad6-60392cbd518f for instance 33296a29-1e67-414b-b7d7-fa06e688b240 on user Apr 12 00:56:10 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] Creating event network-vif-plugged:afefdc63-0a38-4e64-aad6-60392cbd518f for instance 33296a29-1e67-414b-b7d7-fa06e688b240 on user Apr 12 00:56:10 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] Creating event network-vif-plugged:afefdc63-0a38-4e64-aad6-60392cbd518f for instance 33296a29-1e67-414b-b7d7-fa06e688b240 on user Apr 12 00:56:10 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] Creating event network-vif-unplugged:afefdc63-0a38-4e64-aad6-60392cbd518f for instance 33296a29-1e67-414b-b7d7-fa06e688b240 on user Apr 12 00:56:10 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] Creating event network-vif-plugged:afefdc63-0a38-4e64-aad6-60392cbd518f for instance 33296a29-1e67-414b-b7d7-fa06e688b240 on user Apr 12 00:56:10 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-2d5c383f-309e-4f8a-abd1-d50d576370c5 req-141a43dc-7dcb-4029-a104-04904c82c233 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.042684 Apr 12 00:56:10 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 333/994] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:56:10 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:56:37 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:56:37 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:56:37 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-99252a0c-24d2-4683-95af-411e2518cd44 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:56:37 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-99252a0c-24d2-4683-95af-411e2518cd44 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:56:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-99252a0c-24d2-4683-95af-411e2518cd44 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-99252a0c-24d2-4683-95af-411e2518cd44 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-99252a0c-24d2-4683-95af-411e2518cd44 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-99252a0c-24d2-4683-95af-411e2518cd44 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-99252a0c-24d2-4683-95af-411e2518cd44 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:37 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-99252a0c-24d2-4683-95af-411e2518cd44 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:37 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-99252a0c-24d2-4683-95af-411e2518cd44 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.095299 Apr 12 00:56:37 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 333/995] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 00:56:37 2023] GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db/os-interface => generated 283 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:56:38 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:56:38 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:56:38 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:56:38 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=8 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:56:38 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-2124455143"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:56:38 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:56:38 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-9dfb4edf-6e25-4809-a2b1-a53ec477abac req-b28b576d-be48-4be5-99ca-5758cd730a93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a67c354-55e9-4f42-bda3-35d16bf192db", "tag": "d04a1887-8740-4c6c-a7b6-5e9e395ced98"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:56:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:38 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:38 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-9dfb4edf-6e25-4809-a2b1-a53ec477abac req-b28b576d-be48-4be5-99ca-5758cd730a93 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:38 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-9dfb4edf-6e25-4809-a2b1-a53ec477abac req-b28b576d-be48-4be5-99ca-5758cd730a93 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:38 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-9dfb4edf-6e25-4809-a2b1-a53ec477abac req-b28b576d-be48-4be5-99ca-5758cd730a93 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:38 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-9dfb4edf-6e25-4809-a2b1-a53ec477abac req-b28b576d-be48-4be5-99ca-5758cd730a93 service nova] Creating event network-changed:d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance 4a67c354-55e9-4f42-bda3-35d16bf192db on user Apr 12 00:56:38 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-9dfb4edf-6e25-4809-a2b1-a53ec477abac req-b28b576d-be48-4be5-99ca-5758cd730a93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094592 Apr 12 00:56:38 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 330/996] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:56:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:56:39 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-8995330a-2e46-4c85-8660-cecd91c33d02 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db/action" status: 202 len: 0 microversion: 2.1 time: 0.979643 Apr 12 00:56:39 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 334/997] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 00:56:38 2023] POST /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db/action => generated 0 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 12 00:56:39 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-088bd33d-7b29-468d-beb3-155fda9bca53 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Calling method '.version_select at 0x7f7cd461bc70>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:56:39 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-088bd33d-7b29-468d-beb3-155fda9bca53 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "GET /compute/v2.1/images/dfe86d03-a733-4f19-9cc7-56074698a841" status: 200 len: 1611 microversion: 2.1 time: 0.054130 Apr 12 00:56:39 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 334/998] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 12 00:56:39 2023] GET /compute/v2.1/images/dfe86d03-a733-4f19-9cc7-56074698a841 => generated 1611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:56:50 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:56:50 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:56:50 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-988be0c4-bd67-4ae1-9813-2f65b5b636cb tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:56:50 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-988be0c4-bd67-4ae1-9813-2f65b5b636cb tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:56:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-988be0c4-bd67-4ae1-9813-2f65b5b636cb tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-988be0c4-bd67-4ae1-9813-2f65b5b636cb tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-988be0c4-bd67-4ae1-9813-2f65b5b636cb tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-988be0c4-bd67-4ae1-9813-2f65b5b636cb tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-988be0c4-bd67-4ae1-9813-2f65b5b636cb tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-988be0c4-bd67-4ae1-9813-2f65b5b636cb tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:50 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-988be0c4-bd67-4ae1-9813-2f65b5b636cb tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.147312 Apr 12 00:56:50 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 331/999] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 00:56:50 2023] GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608/os-interface => generated 283 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:56:50 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:56:50 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:56:50 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:56:50 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=4 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:56:50 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-7c982a79-f618-4c93-8a0f-2ca99ada5d90 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:56:50 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-7c982a79-f618-4c93-8a0f-2ca99ada5d90 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:56:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7c982a79-f618-4c93-8a0f-2ca99ada5d90 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7c982a79-f618-4c93-8a0f-2ca99ada5d90 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:51 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-eab5a42b-89bf-429f-be6e-8aeaefe2395f req-e6e308dd-9c34-4019-b66e-491d33010ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e24bbae-7697-4c46-9c68-48d8393da608", "tag": "6c9e7810-9a63-4360-889c-edbd6af6ba4f"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:56:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7c982a79-f618-4c93-8a0f-2ca99ada5d90 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7c982a79-f618-4c93-8a0f-2ca99ada5d90 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7c982a79-f618-4c93-8a0f-2ca99ada5d90 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:51 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7c982a79-f618-4c93-8a0f-2ca99ada5d90 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:51 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-eab5a42b-89bf-429f-be6e-8aeaefe2395f req-e6e308dd-9c34-4019-b66e-491d33010ad4 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:51 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-eab5a42b-89bf-429f-be6e-8aeaefe2395f req-e6e308dd-9c34-4019-b66e-491d33010ad4 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:51 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-eab5a42b-89bf-429f-be6e-8aeaefe2395f req-e6e308dd-9c34-4019-b66e-491d33010ad4 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:51 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-eab5a42b-89bf-429f-be6e-8aeaefe2395f req-e6e308dd-9c34-4019-b66e-491d33010ad4 service nova] Creating event network-changed:6c9e7810-9a63-4360-889c-edbd6af6ba4f for instance 4e24bbae-7697-4c46-9c68-48d8393da608 on user Apr 12 00:56:51 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-7c982a79-f618-4c93-8a0f-2ca99ada5d90 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608/ips" status: 200 len: 111 microversion: 2.20 time: 0.038452 Apr 12 00:56:51 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 335/1000] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 12 00:56:50 2023] GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608/ips => generated 111 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:56:51 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-eab5a42b-89bf-429f-be6e-8aeaefe2395f req-e6e308dd-9c34-4019-b66e-491d33010ad4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089977 Apr 12 00:56:51 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 335/1001] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:56:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:56:52 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:56:52 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:56:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:52 user devstack@n-api.service[72495]: DEBUG nova.objects.instance [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lazy-loading 'flavor' on Instance uuid 4e24bbae-7697-4c46-9c68-48d8393da608 {{(pid=72495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:56:53 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-21e7c14f-5265-47f7-bbca-95e91e56426b tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608/action" status: 202 len: 0 microversion: 2.20 time: 0.860645 Apr 12 00:56:53 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 332/1002] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 00:56:52 2023] POST /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608/action => generated 0 bytes in 862 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:56:53 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-3c648665-f428-4609-a1b4-b0f70427cea4 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:56:53 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-3c648665-f428-4609-a1b4-b0f70427cea4 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:56:53 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3c648665-f428-4609-a1b4-b0f70427cea4 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:53 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3c648665-f428-4609-a1b4-b0f70427cea4 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:53 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3c648665-f428-4609-a1b4-b0f70427cea4 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:53 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3c648665-f428-4609-a1b4-b0f70427cea4 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:53 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3c648665-f428-4609-a1b4-b0f70427cea4 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:53 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-3c648665-f428-4609-a1b4-b0f70427cea4 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:53 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-3c648665-f428-4609-a1b4-b0f70427cea4 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:56:53 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-3c648665-f428-4609-a1b4-b0f70427cea4 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:56:53 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-3c648665-f428-4609-a1b4-b0f70427cea4 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:56:53 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-3c648665-f428-4609-a1b4-b0f70427cea4 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608" status: 200 len: 1713 microversion: 2.20 time: 0.184711 Apr 12 00:56:53 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 336/1003] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:56:53 2023] GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608 => generated 1713 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:56:53 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-d26a3655-70f6-4e0e-80dc-8726698259b3 req-c8b80298-10aa-4aab-a61f-2dcf237d8bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e24bbae-7697-4c46-9c68-48d8393da608", "name": "network-vif-unplugged", "status": "completed", "tag": "6c9e7810-9a63-4360-889c-edbd6af6ba4f"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:56:53 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d26a3655-70f6-4e0e-80dc-8726698259b3 req-c8b80298-10aa-4aab-a61f-2dcf237d8bfa service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:53 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d26a3655-70f6-4e0e-80dc-8726698259b3 req-c8b80298-10aa-4aab-a61f-2dcf237d8bfa service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:53 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d26a3655-70f6-4e0e-80dc-8726698259b3 req-c8b80298-10aa-4aab-a61f-2dcf237d8bfa service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:53 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-d26a3655-70f6-4e0e-80dc-8726698259b3 req-c8b80298-10aa-4aab-a61f-2dcf237d8bfa service nova] Creating event network-vif-unplugged:6c9e7810-9a63-4360-889c-edbd6af6ba4f for instance 4e24bbae-7697-4c46-9c68-48d8393da608 on user Apr 12 00:56:53 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-d26a3655-70f6-4e0e-80dc-8726698259b3 req-c8b80298-10aa-4aab-a61f-2dcf237d8bfa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119952 Apr 12 00:56:53 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 336/1004] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:56:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:56:55 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-d6e73f20-55c3-461d-9298-2c1b81a2f176 req-dd1a0893-6b10-4c7a-9c6a-12851cf41dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e24bbae-7697-4c46-9c68-48d8393da608", "name": "network-vif-plugged", "status": "completed", "tag": "6c9e7810-9a63-4360-889c-edbd6af6ba4f"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:56:55 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d6e73f20-55c3-461d-9298-2c1b81a2f176 req-dd1a0893-6b10-4c7a-9c6a-12851cf41dee service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:55 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d6e73f20-55c3-461d-9298-2c1b81a2f176 req-dd1a0893-6b10-4c7a-9c6a-12851cf41dee service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:55 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-d6e73f20-55c3-461d-9298-2c1b81a2f176 req-dd1a0893-6b10-4c7a-9c6a-12851cf41dee service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:55 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-d6e73f20-55c3-461d-9298-2c1b81a2f176 req-dd1a0893-6b10-4c7a-9c6a-12851cf41dee service nova] Creating event network-vif-plugged:6c9e7810-9a63-4360-889c-edbd6af6ba4f for instance 4e24bbae-7697-4c46-9c68-48d8393da608 on user Apr 12 00:56:55 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-d6e73f20-55c3-461d-9298-2c1b81a2f176 req-dd1a0893-6b10-4c7a-9c6a-12851cf41dee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035337 Apr 12 00:56:55 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 333/1005] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:56:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:56:57 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-32bdf4ba-3a51-4fae-b5ce-e2a0dc103a21 req-3db5524b-07a6-4282-b7c6-da7d3d4eda2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e24bbae-7697-4c46-9c68-48d8393da608", "tag": "6c9e7810-9a63-4360-889c-edbd6af6ba4f"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:56:57 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-32bdf4ba-3a51-4fae-b5ce-e2a0dc103a21 req-3db5524b-07a6-4282-b7c6-da7d3d4eda2a service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:57 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-32bdf4ba-3a51-4fae-b5ce-e2a0dc103a21 req-3db5524b-07a6-4282-b7c6-da7d3d4eda2a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:57 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-32bdf4ba-3a51-4fae-b5ce-e2a0dc103a21 req-3db5524b-07a6-4282-b7c6-da7d3d4eda2a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:57 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-32bdf4ba-3a51-4fae-b5ce-e2a0dc103a21 req-3db5524b-07a6-4282-b7c6-da7d3d4eda2a service nova] Creating event network-changed:6c9e7810-9a63-4360-889c-edbd6af6ba4f for instance 4e24bbae-7697-4c46-9c68-48d8393da608 on user Apr 12 00:56:57 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-32bdf4ba-3a51-4fae-b5ce-e2a0dc103a21 req-3db5524b-07a6-4282-b7c6-da7d3d4eda2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032679 Apr 12 00:56:57 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 337/1006] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:56:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:56:58 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-67dbbd82-d4ba-4d1a-ae52-811af614d7ec tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:56:58 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-67dbbd82-d4ba-4d1a-ae52-811af614d7ec tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 33296a29-1e67-414b-b7d7-fa06e688b240] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:56:58 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-67dbbd82-d4ba-4d1a-ae52-811af614d7ec tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:58 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-67dbbd82-d4ba-4d1a-ae52-811af614d7ec tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:58 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-67dbbd82-d4ba-4d1a-ae52-811af614d7ec tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:58 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-67dbbd82-d4ba-4d1a-ae52-811af614d7ec tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:58 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-67dbbd82-d4ba-4d1a-ae52-811af614d7ec tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:58 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-67dbbd82-d4ba-4d1a-ae52-811af614d7ec tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:58 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-67dbbd82-d4ba-4d1a-ae52-811af614d7ec tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] HTTP exception thrown: Instance 33296a29-1e67-414b-b7d7-fa06e688b240 could not be found. Apr 12 00:56:58 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-67dbbd82-d4ba-4d1a-ae52-811af614d7ec tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Request method failure captured: Apr 12 00:56:58 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/33296a29-1e67-414b-b7d7-fa06e688b240 HTTP/1.1 Apr 12 00:56:58 user devstack@n-api.service[72496]: Accept: application/json Apr 12 00:56:58 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 00:56:58 user devstack@n-api.service[72496]: Connection: close Apr 12 00:56:58 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 00:56:58 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 00:56:58 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 00:56:58 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 00:56:58 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 00:56:58 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNgE3AY4UJc8g1YoYn8Mf6dvqK7sxc_8f_SrdPgfyZs25SFFCc2ZZvdYIYEQio4ba_TvXzVb9SAjpjP_SS-rjey5r1XYn32b7lyQEf_7rfmrYfVh6LozqqeOyVHh8sXxhe6n_P6-EHmuK3M41ksJ9WN0FYBpSLBXQWx9vCdnGLhZuWZw Apr 12 00:56:58 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 00:56:58 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 00:56:58 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 00:56:58 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 00:56:58 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 00:56:58 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 00:56:58 user devstack@n-api.service[72496]: X-Project-Id: 38c3f0ad11ac49aaaec0a9c1827ddadb Apr 12 00:56:58 user devstack@n-api.service[72496]: X-Project-Name: tempest-VolumesActionsTest-1257118853 Apr 12 00:56:58 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 00:56:58 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 00:56:58 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/38c3f0ad11ac49aaaec0a9c1827ddadb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/38c3f0ad11ac49aaaec0a9c1827ddadb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/38c3f0ad11ac49aaaec0a9c1827ddadb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:56:58 user devstack@n-api.service[72496]: X-Tenant: tempest-VolumesActionsTest-1257118853 Apr 12 00:56:58 user devstack@n-api.service[72496]: X-Tenant-Id: 38c3f0ad11ac49aaaec0a9c1827ddadb Apr 12 00:56:58 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-VolumesActionsTest-1257118853 Apr 12 00:56:58 user devstack@n-api.service[72496]: X-User: tempest-VolumesActionsTest-1257118853-project-member Apr 12 00:56:58 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 00:56:58 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 00:56:58 user devstack@n-api.service[72496]: X-User-Id: 845fc21f48594cb28ac9c770612a1830 Apr 12 00:56:58 user devstack@n-api.service[72496]: X-User-Name: tempest-VolumesActionsTest-1257118853-project-member Apr 12 00:56:58 user devstack@n-api.service[72496]: method: > Apr 12 00:56:58 user devstack@n-api.service[72496]: exception: Instance 33296a29-1e67-414b-b7d7-fa06e688b240 could not be found. Apr 12 00:56:58 user devstack@n-api.service[72496]: action_args: {'id': '33296a29-1e67-414b-b7d7-fa06e688b240'} Apr 12 00:56:58 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33296a29-1e67-414b-b7d7-fa06e688b240 could not be found. Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33296a29-1e67-414b-b7d7-fa06e688b240 could not be found. Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33296a29-1e67-414b-b7d7-fa06e688b240 could not be found. Apr 12 00:56:58 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 00:56:58 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-67dbbd82-d4ba-4d1a-ae52-811af614d7ec tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Returning 404 to user: Instance 33296a29-1e67-414b-b7d7-fa06e688b240 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:56:58 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-67dbbd82-d4ba-4d1a-ae52-811af614d7ec tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] 10.0.0.210 "GET /compute/v2.1/servers/33296a29-1e67-414b-b7d7-fa06e688b240" status: 404 len: 111 microversion: 2.1 time: 0.091599 Apr 12 00:56:58 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 337/1007] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:56:58 2023] GET /compute/v2.1/servers/33296a29-1e67-414b-b7d7-fa06e688b240 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 00:56:59 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-148486663", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "networks": [{"uuid": "49b3318f-9e48-43d8-97b1-1a2ec225e079"}]}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:56:59 user devstack@n-api.service[72495]: DEBUG nova.network.neutron [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] validate_networks() for [('49b3318f-9e48-43d8-97b1-1a2ec225e079', None, None, None, None, None)] {{(pid=72495) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 00:56:59 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Flavor limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 00:56:59 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Image limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 00:56:59 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Flavor pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 00:56:59 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Image pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 00:56:59 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 00:56:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:56:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:56:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:56:59 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Getting quotas for project 38c3f0ad11ac49aaaec0a9c1827ddadb. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 00:56:59 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Getting quotas for user 845fc21f48594cb28ac9c770612a1830 and project 38c3f0ad11ac49aaaec0a9c1827ddadb. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 00:56:59 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Going to run 1 instances... {{(pid=72495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 00:56:59 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 00:56:59 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-62fbe1e1-455a-4d1d-b930-de69575c01da tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.528314 Apr 12 00:56:59 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 334/1008] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 00:56:59 2023] POST /compute/v2.1/servers => generated 378 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 00:56:59 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-fb80f3fe-7a71-4912-8967-93033f0e32fb tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:56:59 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-fb80f3fe-7a71-4912-8967-93033f0e32fb tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:56:59 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-fb80f3fe-7a71-4912-8967-93033f0e32fb tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845fc21f48594cb28ac9c770612a1830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c3f0ad11ac49aaaec0a9c1827ddadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:56:59 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-fb80f3fe-7a71-4912-8967-93033f0e32fb tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c15d2ee-f758-414a-8167-aa95c17e60aa" status: 200 len: 1207 microversion: 2.1 time: 0.063683 Apr 12 00:56:59 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 338/1009] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:56:59 2023] GET /compute/v2.1/servers/2c15d2ee-f758-414a-8167-aa95c17e60aa => generated 1207 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:57:02 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-3318ce50-523b-497e-b5ba-3c306eb116f8 req-136952a5-d28c-4d13-9187-a2791d8d2cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c15d2ee-f758-414a-8167-aa95c17e60aa", "tag": "eb075efa-9c5e-44db-b287-8172cee0658b"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:57:02 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-3318ce50-523b-497e-b5ba-3c306eb116f8 req-136952a5-d28c-4d13-9187-a2791d8d2cd5 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:57:02 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-3318ce50-523b-497e-b5ba-3c306eb116f8 req-136952a5-d28c-4d13-9187-a2791d8d2cd5 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:57:02 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-3318ce50-523b-497e-b5ba-3c306eb116f8 req-136952a5-d28c-4d13-9187-a2791d8d2cd5 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:57:02 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-3318ce50-523b-497e-b5ba-3c306eb116f8 req-136952a5-d28c-4d13-9187-a2791d8d2cd5 service nova] Creating event network-changed:eb075efa-9c5e-44db-b287-8172cee0658b for instance 2c15d2ee-f758-414a-8167-aa95c17e60aa on user Apr 12 00:57:02 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-3318ce50-523b-497e-b5ba-3c306eb116f8 req-136952a5-d28c-4d13-9187-a2791d8d2cd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051872 Apr 12 00:57:02 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 338/1010] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:57:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:57:04 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-935ed27b-fde5-4cdf-9a5d-87738c01565e req-8d7119bb-d026-4a64-8606-f99a2b348df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c15d2ee-f758-414a-8167-aa95c17e60aa", "name": "network-vif-plugged", "status": "completed", "tag": "eb075efa-9c5e-44db-b287-8172cee0658b"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:57:04 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-935ed27b-fde5-4cdf-9a5d-87738c01565e req-8d7119bb-d026-4a64-8606-f99a2b348df8 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:57:04 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-935ed27b-fde5-4cdf-9a5d-87738c01565e req-8d7119bb-d026-4a64-8606-f99a2b348df8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:57:04 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-935ed27b-fde5-4cdf-9a5d-87738c01565e req-8d7119bb-d026-4a64-8606-f99a2b348df8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:57:04 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-935ed27b-fde5-4cdf-9a5d-87738c01565e req-8d7119bb-d026-4a64-8606-f99a2b348df8 service nova] Creating event network-vif-plugged:eb075efa-9c5e-44db-b287-8172cee0658b for instance 2c15d2ee-f758-414a-8167-aa95c17e60aa on user Apr 12 00:57:04 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-935ed27b-fde5-4cdf-9a5d-87738c01565e req-8d7119bb-d026-4a64-8606-f99a2b348df8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031352 Apr 12 00:57:04 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 335/1011] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:57:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:57:06 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-f2b78b82-e1ea-4e3f-8a30-19feb1468752 req-bad7ea14-dc39-494b-829a-9afc97e5b80d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c15d2ee-f758-414a-8167-aa95c17e60aa", "name": "network-vif-plugged", "status": "completed", "tag": "eb075efa-9c5e-44db-b287-8172cee0658b"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:57:06 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f2b78b82-e1ea-4e3f-8a30-19feb1468752 req-bad7ea14-dc39-494b-829a-9afc97e5b80d service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:57:06 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f2b78b82-e1ea-4e3f-8a30-19feb1468752 req-bad7ea14-dc39-494b-829a-9afc97e5b80d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:57:06 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-f2b78b82-e1ea-4e3f-8a30-19feb1468752 req-bad7ea14-dc39-494b-829a-9afc97e5b80d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:57:06 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-f2b78b82-e1ea-4e3f-8a30-19feb1468752 req-bad7ea14-dc39-494b-829a-9afc97e5b80d service nova] Creating event network-vif-plugged:eb075efa-9c5e-44db-b287-8172cee0658b for instance 2c15d2ee-f758-414a-8167-aa95c17e60aa on user Apr 12 00:57:06 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-f2b78b82-e1ea-4e3f-8a30-19feb1468752 req-bad7ea14-dc39-494b-829a-9afc97e5b80d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043442 Apr 12 00:57:06 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 339/1012] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:57:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:57:29 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=8 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:57:29 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=8 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:57:29 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-4ee74ee9-08af-4f29-ae09-35f056f2be39 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Calling method '.version_select at 0x7f7cd46723b0>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:57:29 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-4ee74ee9-08af-4f29-ae09-35f056f2be39 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "GET /compute/v2.1/images/dfe86d03-a733-4f19-9cc7-56074698a841" status: 200 len: 1725 microversion: 2.1 time: 0.076333 Apr 12 00:57:29 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 339/1013] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 12 00:57:29 2023] GET /compute/v2.1/images/dfe86d03-a733-4f19-9cc7-56074698a841 => generated 1725 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:57:30 user devstack@n-api.service[72495]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d204f24b-50e4-4145-ba20-980194a55823] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 00:57:30 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:57:30 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:57:30 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:57:30 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:57:30 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-dba271cd-085e-41ee-855b-76bf672a7341 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Calling method '.version_select at 0x7f7cd466de10>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:57:30 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-dba271cd-085e-41ee-855b-76bf672a7341 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "GET /compute/v2.1/images/dfe86d03-a733-4f19-9cc7-56074698a841" status: 200 len: 1725 microversion: 2.1 time: 0.067494 Apr 12 00:57:30 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 336/1014] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 12 00:57:30 2023] GET /compute/v2.1/images/dfe86d03-a733-4f19-9cc7-56074698a841 => generated 1725 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:57:30 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:57:30 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=12 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:57:30 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=14 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:57:30 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-dc449017-df30-411c-8203-3b687b398fe8 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:57:30 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-dc449017-df30-411c-8203-3b687b398fe8 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:57:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-dc449017-df30-411c-8203-3b687b398fe8 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:57:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-dc449017-df30-411c-8203-3b687b398fe8 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:57:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-dc449017-df30-411c-8203-3b687b398fe8 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:57:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-dc449017-df30-411c-8203-3b687b398fe8 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:57:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-dc449017-df30-411c-8203-3b687b398fe8 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:57:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-dc449017-df30-411c-8203-3b687b398fe8 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:57:30 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-dc449017-df30-411c-8203-3b687b398fe8 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aedb8da82a64bdcaeff07c649f05379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ca08eae6134a639c5f532e0742b3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:57:30 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-dc449017-df30-411c-8203-3b687b398fe8 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db" status: 200 len: 1671 microversion: 2.1 time: 0.197689 Apr 12 00:57:30 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 340/1015] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:57:30 2023] GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db => generated 1671 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:57:43 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-ae7aeaa1-2411-4318-9f53-a53bdad0dba2 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:57:43 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-ae7aeaa1-2411-4318-9f53-a53bdad0dba2 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:57:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-ae7aeaa1-2411-4318-9f53-a53bdad0dba2 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:57:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-ae7aeaa1-2411-4318-9f53-a53bdad0dba2 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:57:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-ae7aeaa1-2411-4318-9f53-a53bdad0dba2 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:57:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-ae7aeaa1-2411-4318-9f53-a53bdad0dba2 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:57:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-ae7aeaa1-2411-4318-9f53-a53bdad0dba2 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:57:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-ae7aeaa1-2411-4318-9f53-a53bdad0dba2 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:57:43 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-ae7aeaa1-2411-4318-9f53-a53bdad0dba2 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:57:43 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-ae7aeaa1-2411-4318-9f53-a53bdad0dba2 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:57:43 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-ae7aeaa1-2411-4318-9f53-a53bdad0dba2 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:57:43 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-ae7aeaa1-2411-4318-9f53-a53bdad0dba2 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608" status: 200 len: 1654 microversion: 2.20 time: 0.173078 Apr 12 00:57:43 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 340/1016] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:57:43 2023] GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608 => generated 1654 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:57:49 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-6bbb7590-722a-4f43-8b1d-67cb732b964c tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:57:49 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-6bbb7590-722a-4f43-8b1d-67cb732b964c tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:57:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6bbb7590-722a-4f43-8b1d-67cb732b964c tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:57:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6bbb7590-722a-4f43-8b1d-67cb732b964c tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:57:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6bbb7590-722a-4f43-8b1d-67cb732b964c tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:57:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6bbb7590-722a-4f43-8b1d-67cb732b964c tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:57:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6bbb7590-722a-4f43-8b1d-67cb732b964c tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:57:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-6bbb7590-722a-4f43-8b1d-67cb732b964c tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:57:49 user devstack@n-api.service[72495]: INFO oslo.messaging._drivers.impl_rabbit [-] [d204f24b-50e4-4145-ba20-980194a55823] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 33130. Apr 12 00:57:49 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-6bbb7590-722a-4f43-8b1d-67cb732b964c tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845fc21f48594cb28ac9c770612a1830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c3f0ad11ac49aaaec0a9c1827ddadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:57:49 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-6bbb7590-722a-4f43-8b1d-67cb732b964c tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c15d2ee-f758-414a-8167-aa95c17e60aa" status: 200 len: 1484 microversion: 2.1 time: 0.167950 Apr 12 00:57:49 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 337/1017] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:57:49 2023] GET /compute/v2.1/servers/2c15d2ee-f758-414a-8167-aa95c17e60aa => generated 1484 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:58:30 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:58:30 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=6 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:58:30 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-6bd41f54-f3bc-4110-b491-001767baa21b tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:58:30 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-6bd41f54-f3bc-4110-b491-001767baa21b tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:58:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-6bd41f54-f3bc-4110-b491-001767baa21b tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-6bd41f54-f3bc-4110-b491-001767baa21b tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-6bd41f54-f3bc-4110-b491-001767baa21b tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-6bd41f54-f3bc-4110-b491-001767baa21b tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-6bd41f54-f3bc-4110-b491-001767baa21b tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-6bd41f54-f3bc-4110-b491-001767baa21b tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:30 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-6bd41f54-f3bc-4110-b491-001767baa21b tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aedb8da82a64bdcaeff07c649f05379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ca08eae6134a639c5f532e0742b3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:58:30 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-6bd41f54-f3bc-4110-b491-001767baa21b tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db" status: 200 len: 1671 microversion: 2.1 time: 0.175477 Apr 12 00:58:30 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 341/1018] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:58:30 2023] GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db => generated 1671 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:58:32 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:58:32 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:58:32 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e40b29b9-23d9-4c1e-88f1-f95983dbe508"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:58:32 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:58:32 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:32 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:32 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:32 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:32 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:32 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:32 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-1bf941f0-c8c0-40bd-a442-44db66f9fc2a tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295269 Apr 12 00:58:32 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 341/1019] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 00:58:32 2023] POST /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:58:38 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "dfe86d03-a733-4f19-9cc7-56074698a841"}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:58:38 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:58:38 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:58:38 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:58:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:39 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:39 user devstack@n-api.service[72495]: DEBUG nova.objects.instance [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lazy-loading 'flavor' on Instance uuid 4a67c354-55e9-4f42-bda3-35d16bf192db {{(pid=72495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 00:58:39 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-feff647b-b132-4979-a072-2c88f51c86a3 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db/action" status: 200 len: 29 microversion: 2.1 time: 0.209645 Apr 12 00:58:39 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 338/1020] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 00:58:38 2023] POST /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db/action => generated 29 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 00:58:39 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-50fe4e9a-a4c4-4399-bf06-ffd716b855bf tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:58:39 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-50fe4e9a-a4c4-4399-bf06-ffd716b855bf tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:58:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-50fe4e9a-a4c4-4399-bf06-ffd716b855bf tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-50fe4e9a-a4c4-4399-bf06-ffd716b855bf tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-50fe4e9a-a4c4-4399-bf06-ffd716b855bf tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-50fe4e9a-a4c4-4399-bf06-ffd716b855bf tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-50fe4e9a-a4c4-4399-bf06-ffd716b855bf tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:39 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-50fe4e9a-a4c4-4399-bf06-ffd716b855bf tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:39 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-50fe4e9a-a4c4-4399-bf06-ffd716b855bf tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aedb8da82a64bdcaeff07c649f05379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ca08eae6134a639c5f532e0742b3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:58:39 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-50fe4e9a-a4c4-4399-bf06-ffd716b855bf tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db" status: 200 len: 1723 microversion: 2.1 time: 0.152553 Apr 12 00:58:39 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 342/1021] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:58:39 2023] GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:58:40 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-fb71cb34-64a2-47b9-8437-b6bdb0c0c975 req-3400238e-3f78-4896-9ab5-d257a829fb21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a67c354-55e9-4f42-bda3-35d16bf192db", "name": "network-vif-unplugged", "status": "completed", "tag": "d04a1887-8740-4c6c-a7b6-5e9e395ced98"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:58:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-fb71cb34-64a2-47b9-8437-b6bdb0c0c975 req-3400238e-3f78-4896-9ab5-d257a829fb21 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-fb71cb34-64a2-47b9-8437-b6bdb0c0c975 req-3400238e-3f78-4896-9ab5-d257a829fb21 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-fb71cb34-64a2-47b9-8437-b6bdb0c0c975 req-3400238e-3f78-4896-9ab5-d257a829fb21 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:40 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-fb71cb34-64a2-47b9-8437-b6bdb0c0c975 req-3400238e-3f78-4896-9ab5-d257a829fb21 service nova] Creating event network-vif-unplugged:d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance 4a67c354-55e9-4f42-bda3-35d16bf192db on user Apr 12 00:58:40 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-fb71cb34-64a2-47b9-8437-b6bdb0c0c975 req-3400238e-3f78-4896-9ab5-d257a829fb21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033173 Apr 12 00:58:40 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 342/1022] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:58:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:58:42 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-b35529ae-7eb8-4967-b76c-deecd078ce65 req-6e5fa888-8ccb-4456-b82c-6914f7a86bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a67c354-55e9-4f42-bda3-35d16bf192db", "name": "network-vif-plugged", "status": "completed", "tag": "d04a1887-8740-4c6c-a7b6-5e9e395ced98"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:58:42 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-b35529ae-7eb8-4967-b76c-deecd078ce65 req-6e5fa888-8ccb-4456-b82c-6914f7a86bb7 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:42 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-b35529ae-7eb8-4967-b76c-deecd078ce65 req-6e5fa888-8ccb-4456-b82c-6914f7a86bb7 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:42 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-b35529ae-7eb8-4967-b76c-deecd078ce65 req-6e5fa888-8ccb-4456-b82c-6914f7a86bb7 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:42 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-b35529ae-7eb8-4967-b76c-deecd078ce65 req-6e5fa888-8ccb-4456-b82c-6914f7a86bb7 service nova] Creating event network-vif-plugged:d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance 4a67c354-55e9-4f42-bda3-35d16bf192db on user Apr 12 00:58:42 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-b35529ae-7eb8-4967-b76c-deecd078ce65 req-6e5fa888-8ccb-4456-b82c-6914f7a86bb7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127253 Apr 12 00:58:42 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 339/1023] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:58:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:58:43 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-9d01d5b1-d39b-4950-a3f6-59e20df1d32d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a032a1d7-d513-4674-95d7-2a27ee648918"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:58:43 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-9d01d5b1-d39b-4950-a3f6-59e20df1d32d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:58:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9d01d5b1-d39b-4950-a3f6-59e20df1d32d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9d01d5b1-d39b-4950-a3f6-59e20df1d32d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9d01d5b1-d39b-4950-a3f6-59e20df1d32d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9d01d5b1-d39b-4950-a3f6-59e20df1d32d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9d01d5b1-d39b-4950-a3f6-59e20df1d32d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9d01d5b1-d39b-4950-a3f6-59e20df1d32d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:44 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-9d01d5b1-d39b-4950-a3f6-59e20df1d32d tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.514255 Apr 12 00:58:44 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 343/1024] 10.0.0.210 () {66 vars in 1441 bytes} [Wed Apr 12 00:58:43 2023] POST /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608/os-volume_attachments => generated 188 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 00:58:44 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-e3acb3cb-19d0-4c94-bac6-ec2653c16bc1 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:58:44 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-e3acb3cb-19d0-4c94-bac6-ec2653c16bc1 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:58:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-e3acb3cb-19d0-4c94-bac6-ec2653c16bc1 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-e3acb3cb-19d0-4c94-bac6-ec2653c16bc1 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-e3acb3cb-19d0-4c94-bac6-ec2653c16bc1 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-e3acb3cb-19d0-4c94-bac6-ec2653c16bc1 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-e3acb3cb-19d0-4c94-bac6-ec2653c16bc1 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-e3acb3cb-19d0-4c94-bac6-ec2653c16bc1 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:44 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-032fc55a-8f6e-44f3-8dc2-189f3c4e8e82 req-c89849dc-3b88-4412-b205-92a5f353ef8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a67c354-55e9-4f42-bda3-35d16bf192db", "name": "network-vif-plugged", "status": "completed", "tag": "d04a1887-8740-4c6c-a7b6-5e9e395ced98"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:58:44 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-032fc55a-8f6e-44f3-8dc2-189f3c4e8e82 req-c89849dc-3b88-4412-b205-92a5f353ef8c service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:44 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-032fc55a-8f6e-44f3-8dc2-189f3c4e8e82 req-c89849dc-3b88-4412-b205-92a5f353ef8c service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:44 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-032fc55a-8f6e-44f3-8dc2-189f3c4e8e82 req-c89849dc-3b88-4412-b205-92a5f353ef8c service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:44 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-032fc55a-8f6e-44f3-8dc2-189f3c4e8e82 req-c89849dc-3b88-4412-b205-92a5f353ef8c service nova] Creating event network-vif-plugged:d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance 4a67c354-55e9-4f42-bda3-35d16bf192db on user Apr 12 00:58:44 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-e3acb3cb-19d0-4c94-bac6-ec2653c16bc1 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608/os-volume_attachments/a032a1d7-d513-4674-95d7-2a27ee648918" status: 202 len: 0 microversion: 2.20 time: 0.292097 Apr 12 00:58:44 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-032fc55a-8f6e-44f3-8dc2-189f3c4e8e82 req-c89849dc-3b88-4412-b205-92a5f353ef8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032641 Apr 12 00:58:44 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 343/1025] 10.0.0.210 () {64 vars in 1534 bytes} [Wed Apr 12 00:58:44 2023] DELETE /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608/os-volume_attachments/a032a1d7-d513-4674-95d7-2a27ee648918 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:58:44 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 340/1026] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:58:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:58:44 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:58:44 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:58:44 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:44 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:44 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:44 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:44 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:44 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:44 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=72494) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 12 00:58:44 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-451449fb-6b7b-4f63-951e-4af952b8d5f0 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608/action" status: 202 len: 0 microversion: 2.20 time: 0.106073 Apr 12 00:58:44 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 344/1027] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 00:58:44 2023] POST /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:58:44 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-b9f5a2b9-eea6-4be2-86a2-71699d626118 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:58:44 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-b9f5a2b9-eea6-4be2-86a2-71699d626118 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:58:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b9f5a2b9-eea6-4be2-86a2-71699d626118 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b9f5a2b9-eea6-4be2-86a2-71699d626118 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b9f5a2b9-eea6-4be2-86a2-71699d626118 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b9f5a2b9-eea6-4be2-86a2-71699d626118 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b9f5a2b9-eea6-4be2-86a2-71699d626118 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:44 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b9f5a2b9-eea6-4be2-86a2-71699d626118 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:45 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-b9f5a2b9-eea6-4be2-86a2-71699d626118 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:58:45 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-b9f5a2b9-eea6-4be2-86a2-71699d626118 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:58:45 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-b9f5a2b9-eea6-4be2-86a2-71699d626118 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:58:45 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-b9f5a2b9-eea6-4be2-86a2-71699d626118 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608" status: 200 len: 1662 microversion: 2.20 time: 0.168529 Apr 12 00:58:45 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 344/1028] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:58:44 2023] GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608 => generated 1662 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:58:46 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-b467f00a-cf69-4bfc-9b83-f555dc5cc835 req-07ba298a-5328-4cbe-89b4-03878f5da598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a67c354-55e9-4f42-bda3-35d16bf192db", "name": "network-vif-plugged", "status": "completed", "tag": "d04a1887-8740-4c6c-a7b6-5e9e395ced98"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:58:46 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-b467f00a-cf69-4bfc-9b83-f555dc5cc835 req-07ba298a-5328-4cbe-89b4-03878f5da598 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:46 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-b467f00a-cf69-4bfc-9b83-f555dc5cc835 req-07ba298a-5328-4cbe-89b4-03878f5da598 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:46 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-b467f00a-cf69-4bfc-9b83-f555dc5cc835 req-07ba298a-5328-4cbe-89b4-03878f5da598 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:46 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-b467f00a-cf69-4bfc-9b83-f555dc5cc835 req-07ba298a-5328-4cbe-89b4-03878f5da598 service nova] Creating event network-vif-plugged:d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance 4a67c354-55e9-4f42-bda3-35d16bf192db on user Apr 12 00:58:46 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-b467f00a-cf69-4bfc-9b83-f555dc5cc835 req-07ba298a-5328-4cbe-89b4-03878f5da598 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037398 Apr 12 00:58:46 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 341/1029] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:58:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:58:47 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-3c378f26-41c0-4dde-b0f3-e1a13632a475 req-d30d9498-f646-457f-964f-d2e73f7f5b67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e24bbae-7697-4c46-9c68-48d8393da608", "tag": "6c9e7810-9a63-4360-889c-edbd6af6ba4f"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:58:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-3c378f26-41c0-4dde-b0f3-e1a13632a475 req-d30d9498-f646-457f-964f-d2e73f7f5b67 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-3c378f26-41c0-4dde-b0f3-e1a13632a475 req-d30d9498-f646-457f-964f-d2e73f7f5b67 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:47 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-3c378f26-41c0-4dde-b0f3-e1a13632a475 req-d30d9498-f646-457f-964f-d2e73f7f5b67 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:47 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-3c378f26-41c0-4dde-b0f3-e1a13632a475 req-d30d9498-f646-457f-964f-d2e73f7f5b67 service nova] Creating event network-changed:6c9e7810-9a63-4360-889c-edbd6af6ba4f for instance 4e24bbae-7697-4c46-9c68-48d8393da608 on user Apr 12 00:58:47 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-3c378f26-41c0-4dde-b0f3-e1a13632a475 req-d30d9498-f646-457f-964f-d2e73f7f5b67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032201 Apr 12 00:58:47 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 345/1030] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:58:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:58:50 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:58:50 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:58:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:50 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Going to try to terminate instance {{(pid=72496) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 00:58:50 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-23e3485f-c400-4844-a492-cf4a745986db tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2c15d2ee-f758-414a-8167-aa95c17e60aa" status: 204 len: 0 microversion: 2.1 time: 0.131639 Apr 12 00:58:50 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 345/1031] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 00:58:50 2023] DELETE /compute/v2.1/servers/2c15d2ee-f758-414a-8167-aa95c17e60aa => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 00:58:50 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-85b3fff1-af67-456b-957f-27d0a8c559e0 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:58:50 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-85b3fff1-af67-456b-957f-27d0a8c559e0 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:58:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-85b3fff1-af67-456b-957f-27d0a8c559e0 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-85b3fff1-af67-456b-957f-27d0a8c559e0 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-85b3fff1-af67-456b-957f-27d0a8c559e0 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-85b3fff1-af67-456b-957f-27d0a8c559e0 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-85b3fff1-af67-456b-957f-27d0a8c559e0 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:50 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-85b3fff1-af67-456b-957f-27d0a8c559e0 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:50 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-85b3fff1-af67-456b-957f-27d0a8c559e0 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845fc21f48594cb28ac9c770612a1830', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c3f0ad11ac49aaaec0a9c1827ddadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:58:50 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-85b3fff1-af67-456b-957f-27d0a8c559e0 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c15d2ee-f758-414a-8167-aa95c17e60aa" status: 200 len: 1490 microversion: 2.1 time: 0.291901 Apr 12 00:58:50 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 342/1032] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:58:50 2023] GET /compute/v2.1/servers/2c15d2ee-f758-414a-8167-aa95c17e60aa => generated 1490 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:58:50 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-7673ea41-d9e1-4171-85ad-8e912588435c req-3777e349-9f31-4b78-a44c-166e8904e951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c15d2ee-f758-414a-8167-aa95c17e60aa", "name": "network-vif-unplugged", "status": "completed", "tag": "eb075efa-9c5e-44db-b287-8172cee0658b"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:58:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-7673ea41-d9e1-4171-85ad-8e912588435c req-3777e349-9f31-4b78-a44c-166e8904e951 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-7673ea41-d9e1-4171-85ad-8e912588435c req-3777e349-9f31-4b78-a44c-166e8904e951 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-7673ea41-d9e1-4171-85ad-8e912588435c req-3777e349-9f31-4b78-a44c-166e8904e951 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:50 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-7673ea41-d9e1-4171-85ad-8e912588435c req-3777e349-9f31-4b78-a44c-166e8904e951 service nova] Creating event network-vif-unplugged:eb075efa-9c5e-44db-b287-8172cee0658b for instance 2c15d2ee-f758-414a-8167-aa95c17e60aa on user Apr 12 00:58:50 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-7673ea41-d9e1-4171-85ad-8e912588435c req-3777e349-9f31-4b78-a44c-166e8904e951 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031618 Apr 12 00:58:50 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 346/1033] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:58:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:58:52 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-d2a3384d-eef8-4354-9ff6-3483055892d7 req-72e588ca-1995-4910-ac6a-238ff59a5187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c15d2ee-f758-414a-8167-aa95c17e60aa", "name": "network-vif-deleted", "tag": "eb075efa-9c5e-44db-b287-8172cee0658b"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:58:52 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d2a3384d-eef8-4354-9ff6-3483055892d7 req-72e588ca-1995-4910-ac6a-238ff59a5187 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:52 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d2a3384d-eef8-4354-9ff6-3483055892d7 req-72e588ca-1995-4910-ac6a-238ff59a5187 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:52 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d2a3384d-eef8-4354-9ff6-3483055892d7 req-72e588ca-1995-4910-ac6a-238ff59a5187 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:52 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-d2a3384d-eef8-4354-9ff6-3483055892d7 req-72e588ca-1995-4910-ac6a-238ff59a5187 service nova] Creating event network-vif-deleted:eb075efa-9c5e-44db-b287-8172cee0658b for instance 2c15d2ee-f758-414a-8167-aa95c17e60aa on user Apr 12 00:58:52 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-d2a3384d-eef8-4354-9ff6-3483055892d7 req-72e588ca-1995-4910-ac6a-238ff59a5187 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030446 Apr 12 00:58:52 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 346/1034] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:58:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:58:52 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c15d2ee-f758-414a-8167-aa95c17e60aa", "name": "network-vif-plugged", "status": "completed", "tag": "eb075efa-9c5e-44db-b287-8172cee0658b"}, {"server_uuid": "2c15d2ee-f758-414a-8167-aa95c17e60aa", "name": "network-vif-plugged", "status": "completed", "tag": "eb075efa-9c5e-44db-b287-8172cee0658b"}, {"server_uuid": "2c15d2ee-f758-414a-8167-aa95c17e60aa", "name": "network-vif-plugged", "status": "completed", "tag": "eb075efa-9c5e-44db-b287-8172cee0658b"}, {"server_uuid": "2c15d2ee-f758-414a-8167-aa95c17e60aa", "name": "network-vif-unplugged", "status": "completed", "tag": "eb075efa-9c5e-44db-b287-8172cee0658b"}, {"server_uuid": "2c15d2ee-f758-414a-8167-aa95c17e60aa", "name": "network-vif-plugged", "status": "completed", "tag": "eb075efa-9c5e-44db-b287-8172cee0658b"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:58:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:52 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] Creating event network-vif-plugged:eb075efa-9c5e-44db-b287-8172cee0658b for instance 2c15d2ee-f758-414a-8167-aa95c17e60aa on user Apr 12 00:58:52 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] Creating event network-vif-plugged:eb075efa-9c5e-44db-b287-8172cee0658b for instance 2c15d2ee-f758-414a-8167-aa95c17e60aa on user Apr 12 00:58:52 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] Creating event network-vif-plugged:eb075efa-9c5e-44db-b287-8172cee0658b for instance 2c15d2ee-f758-414a-8167-aa95c17e60aa on user Apr 12 00:58:52 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] Creating event network-vif-unplugged:eb075efa-9c5e-44db-b287-8172cee0658b for instance 2c15d2ee-f758-414a-8167-aa95c17e60aa on user Apr 12 00:58:52 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] Creating event network-vif-plugged:eb075efa-9c5e-44db-b287-8172cee0658b for instance 2c15d2ee-f758-414a-8167-aa95c17e60aa on user Apr 12 00:58:53 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-bd052451-77de-4ae2-8694-2011a117a880 req-e2308b07-3ab5-42d6-853b-cb80d77ba4ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.042817 Apr 12 00:58:53 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 343/1035] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:58:52 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:58:54 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-82296beb-7f61-4ace-9d09-c9e321124ba5 req-ce06b45c-05bc-49b0-b772-34adfed3c2a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e24bbae-7697-4c46-9c68-48d8393da608", "name": "network-vif-plugged", "status": "completed", "tag": "6c9e7810-9a63-4360-889c-edbd6af6ba4f"}, {"server_uuid": "4e24bbae-7697-4c46-9c68-48d8393da608", "name": "network-vif-plugged", "status": "completed", "tag": "6c9e7810-9a63-4360-889c-edbd6af6ba4f"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 00:58:54 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-82296beb-7f61-4ace-9d09-c9e321124ba5 req-ce06b45c-05bc-49b0-b772-34adfed3c2a3 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:58:54 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-82296beb-7f61-4ace-9d09-c9e321124ba5 req-ce06b45c-05bc-49b0-b772-34adfed3c2a3 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:58:54 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-82296beb-7f61-4ace-9d09-c9e321124ba5 req-ce06b45c-05bc-49b0-b772-34adfed3c2a3 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:58:54 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-82296beb-7f61-4ace-9d09-c9e321124ba5 req-ce06b45c-05bc-49b0-b772-34adfed3c2a3 service nova] Creating event network-vif-plugged:6c9e7810-9a63-4360-889c-edbd6af6ba4f for instance 4e24bbae-7697-4c46-9c68-48d8393da608 on user Apr 12 00:58:54 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-82296beb-7f61-4ace-9d09-c9e321124ba5 req-ce06b45c-05bc-49b0-b772-34adfed3c2a3 service nova] Creating event network-vif-plugged:6c9e7810-9a63-4360-889c-edbd6af6ba4f for instance 4e24bbae-7697-4c46-9c68-48d8393da608 on user Apr 12 00:58:54 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-82296beb-7f61-4ace-9d09-c9e321124ba5 req-ce06b45c-05bc-49b0-b772-34adfed3c2a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033141 Apr 12 00:58:54 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 347/1036] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 00:58:54 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 00:59:29 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:59:29 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:59:29 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-9ba38595-4d38-4ec7-ae59-ae6785f3c5e1 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:59:29 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-9ba38595-4d38-4ec7-ae59-ae6785f3c5e1 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:59:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9ba38595-4d38-4ec7-ae59-ae6785f3c5e1 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:59:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9ba38595-4d38-4ec7-ae59-ae6785f3c5e1 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:59:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9ba38595-4d38-4ec7-ae59-ae6785f3c5e1 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:59:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9ba38595-4d38-4ec7-ae59-ae6785f3c5e1 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:59:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9ba38595-4d38-4ec7-ae59-ae6785f3c5e1 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:59:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9ba38595-4d38-4ec7-ae59-ae6785f3c5e1 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:59:29 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-9ba38595-4d38-4ec7-ae59-ae6785f3c5e1 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aedb8da82a64bdcaeff07c649f05379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ca08eae6134a639c5f532e0742b3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:59:29 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-9ba38595-4d38-4ec7-ae59-ae6785f3c5e1 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db" status: 200 len: 1703 microversion: 2.1 time: 0.171066 Apr 12 00:59:29 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 347/1037] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:59:29 2023] GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db => generated 1703 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 00:59:35 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=12 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:59:35 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:59:35 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-28cd289d-a5c6-43be-9dec-c1cdacf02136 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:59:35 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-28cd289d-a5c6-43be-9dec-c1cdacf02136 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:59:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-28cd289d-a5c6-43be-9dec-c1cdacf02136 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:59:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-28cd289d-a5c6-43be-9dec-c1cdacf02136 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:59:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-28cd289d-a5c6-43be-9dec-c1cdacf02136 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:59:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-28cd289d-a5c6-43be-9dec-c1cdacf02136 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:59:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-28cd289d-a5c6-43be-9dec-c1cdacf02136 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:59:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-28cd289d-a5c6-43be-9dec-c1cdacf02136 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:59:35 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-28cd289d-a5c6-43be-9dec-c1cdacf02136 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:59:35 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-28cd289d-a5c6-43be-9dec-c1cdacf02136 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:59:35 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-28cd289d-a5c6-43be-9dec-c1cdacf02136 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 00:59:35 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-28cd289d-a5c6-43be-9dec-c1cdacf02136 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608" status: 200 len: 1707 microversion: 2.20 time: 0.163028 Apr 12 00:59:35 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 344/1038] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 00:59:35 2023] GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608 => generated 1707 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 00:59:40 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:59:40 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 00:59:41 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-74c76955-d793-46aa-8d06-4dc14964ab31 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 00:59:41 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-74c76955-d793-46aa-8d06-4dc14964ab31 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] [instance: 2c15d2ee-f758-414a-8167-aa95c17e60aa] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 00:59:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-74c76955-d793-46aa-8d06-4dc14964ab31 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:59:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-74c76955-d793-46aa-8d06-4dc14964ab31 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:59:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-74c76955-d793-46aa-8d06-4dc14964ab31 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:59:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-74c76955-d793-46aa-8d06-4dc14964ab31 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 00:59:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-74c76955-d793-46aa-8d06-4dc14964ab31 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 00:59:41 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-74c76955-d793-46aa-8d06-4dc14964ab31 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 00:59:41 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-74c76955-d793-46aa-8d06-4dc14964ab31 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] HTTP exception thrown: Instance 2c15d2ee-f758-414a-8167-aa95c17e60aa could not be found. Apr 12 00:59:41 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-74c76955-d793-46aa-8d06-4dc14964ab31 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Request method failure captured: Apr 12 00:59:41 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/2c15d2ee-f758-414a-8167-aa95c17e60aa HTTP/1.1 Apr 12 00:59:41 user devstack@n-api.service[72494]: Accept: application/json Apr 12 00:59:41 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 00:59:41 user devstack@n-api.service[72494]: Connection: close Apr 12 00:59:41 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 00:59:41 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 00:59:41 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 00:59:41 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 00:59:41 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 00:59:41 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNgE3AY4UJc8g1YoYn8Mf6dvqK7sxc_8f_SrdPgfyZs25SFFCc2ZZvdYIYEQio4ba_TvXzVb9SAjpjP_SS-rjey5r1XYn32b7lyQEf_7rfmrYfVh6LozqqeOyVHh8sXxhe6n_P6-EHmuK3M41ksJ9WN0FYBpSLBXQWx9vCdnGLhZuWZw Apr 12 00:59:41 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 00:59:41 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 00:59:41 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 00:59:41 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 00:59:41 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 00:59:41 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 00:59:41 user devstack@n-api.service[72494]: X-Project-Id: 38c3f0ad11ac49aaaec0a9c1827ddadb Apr 12 00:59:41 user devstack@n-api.service[72494]: X-Project-Name: tempest-VolumesActionsTest-1257118853 Apr 12 00:59:41 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 00:59:41 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 00:59:41 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/38c3f0ad11ac49aaaec0a9c1827ddadb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/38c3f0ad11ac49aaaec0a9c1827ddadb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/38c3f0ad11ac49aaaec0a9c1827ddadb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 00:59:41 user devstack@n-api.service[72494]: X-Tenant: tempest-VolumesActionsTest-1257118853 Apr 12 00:59:41 user devstack@n-api.service[72494]: X-Tenant-Id: 38c3f0ad11ac49aaaec0a9c1827ddadb Apr 12 00:59:41 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-VolumesActionsTest-1257118853 Apr 12 00:59:41 user devstack@n-api.service[72494]: X-User: tempest-VolumesActionsTest-1257118853-project-member Apr 12 00:59:41 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 00:59:41 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 00:59:41 user devstack@n-api.service[72494]: X-User-Id: 845fc21f48594cb28ac9c770612a1830 Apr 12 00:59:41 user devstack@n-api.service[72494]: X-User-Name: tempest-VolumesActionsTest-1257118853-project-member Apr 12 00:59:41 user devstack@n-api.service[72494]: method: > Apr 12 00:59:41 user devstack@n-api.service[72494]: exception: Instance 2c15d2ee-f758-414a-8167-aa95c17e60aa could not be found. Apr 12 00:59:41 user devstack@n-api.service[72494]: action_args: {'id': '2c15d2ee-f758-414a-8167-aa95c17e60aa'} Apr 12 00:59:41 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c15d2ee-f758-414a-8167-aa95c17e60aa could not be found. Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c15d2ee-f758-414a-8167-aa95c17e60aa could not be found. Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c15d2ee-f758-414a-8167-aa95c17e60aa could not be found. Apr 12 00:59:41 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 00:59:41 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-74c76955-d793-46aa-8d06-4dc14964ab31 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] Returning 404 to user: Instance 2c15d2ee-f758-414a-8167-aa95c17e60aa could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 00:59:41 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-74c76955-d793-46aa-8d06-4dc14964ab31 tempest-VolumesActionsTest-1257118853 tempest-VolumesActionsTest-1257118853-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c15d2ee-f758-414a-8167-aa95c17e60aa" status: 404 len: 111 microversion: 2.1 time: 0.103307 Apr 12 00:59:41 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 348/1039] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 00:59:40 2023] GET /compute/v2.1/servers/2c15d2ee-f758-414a-8167-aa95c17e60aa => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 01:00:29 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:00:29 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:00:29 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-9bf4022d-79d0-4864-bde6-8c3d26072527 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:00:29 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-9bf4022d-79d0-4864-bde6-8c3d26072527 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:00:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9bf4022d-79d0-4864-bde6-8c3d26072527 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:00:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9bf4022d-79d0-4864-bde6-8c3d26072527 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:00:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9bf4022d-79d0-4864-bde6-8c3d26072527 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:00:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9bf4022d-79d0-4864-bde6-8c3d26072527 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:00:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9bf4022d-79d0-4864-bde6-8c3d26072527 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:00:29 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-9bf4022d-79d0-4864-bde6-8c3d26072527 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:00:29 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-9bf4022d-79d0-4864-bde6-8c3d26072527 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db/action" status: 202 len: 0 microversion: 2.1 time: 0.331612 Apr 12 01:00:29 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 348/1040] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 01:00:29 2023] POST /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 01:00:30 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-b14cdc17-7f9a-4fd8-8f95-9343374a856c tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:00:30 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-b14cdc17-7f9a-4fd8-8f95-9343374a856c tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:00:30 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:00:30 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:00:30 user devstack@n-api.service[72495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 01:00:30 user devstack@n-api.service[72495]: Wed Apr 12 01:00:30 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db/os-interface (ip 10.0.0.210) !!! Apr 12 01:00:30 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b14cdc17-7f9a-4fd8-8f95-9343374a856c tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:00:30 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b14cdc17-7f9a-4fd8-8f95-9343374a856c tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:00:30 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b14cdc17-7f9a-4fd8-8f95-9343374a856c tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:00:30 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b14cdc17-7f9a-4fd8-8f95-9343374a856c tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:00:30 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b14cdc17-7f9a-4fd8-8f95-9343374a856c tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:00:30 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b14cdc17-7f9a-4fd8-8f95-9343374a856c tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:00:30 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-b14cdc17-7f9a-4fd8-8f95-9343374a856c tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.133017 Apr 12 01:00:30 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 345/1041] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 01:00:30 2023] GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db/os-interface => generated 283 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:00:31 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-39860e31-6a81-4cdc-9481-b7fc8722e366 req-12886391-2263-473c-af79-92153e469a84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a67c354-55e9-4f42-bda3-35d16bf192db", "name": "network-vif-unplugged", "status": "completed", "tag": "d04a1887-8740-4c6c-a7b6-5e9e395ced98"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:00:31 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:00:31 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:00:31 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-39860e31-6a81-4cdc-9481-b7fc8722e366 req-12886391-2263-473c-af79-92153e469a84 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:00:31 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-39860e31-6a81-4cdc-9481-b7fc8722e366 req-12886391-2263-473c-af79-92153e469a84 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:00:31 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-39860e31-6a81-4cdc-9481-b7fc8722e366 req-12886391-2263-473c-af79-92153e469a84 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:00:31 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-39860e31-6a81-4cdc-9481-b7fc8722e366 req-12886391-2263-473c-af79-92153e469a84 service nova] Creating event network-vif-unplugged:d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance 4a67c354-55e9-4f42-bda3-35d16bf192db on user Apr 12 01:00:31 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-39860e31-6a81-4cdc-9481-b7fc8722e366 req-12886391-2263-473c-af79-92153e469a84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036243 Apr 12 01:00:31 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 349/1042] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:00:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:00:33 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a67c354-55e9-4f42-bda3-35d16bf192db", "tag": "d04a1887-8740-4c6c-a7b6-5e9e395ced98"}, {"name": "network-changed", "server_uuid": "4a67c354-55e9-4f42-bda3-35d16bf192db", "tag": "d04a1887-8740-4c6c-a7b6-5e9e395ced98"}, {"server_uuid": "4a67c354-55e9-4f42-bda3-35d16bf192db", "name": "network-vif-plugged", "status": "completed", "tag": "d04a1887-8740-4c6c-a7b6-5e9e395ced98"}, {"server_uuid": "4a67c354-55e9-4f42-bda3-35d16bf192db", "name": "network-vif-plugged", "status": "completed", "tag": "d04a1887-8740-4c6c-a7b6-5e9e395ced98"}, {"server_uuid": "4a67c354-55e9-4f42-bda3-35d16bf192db", "name": "network-vif-plugged", "status": "completed", "tag": "d04a1887-8740-4c6c-a7b6-5e9e395ced98"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:00:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:00:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:00:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:00:33 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] Creating event network-changed:d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance 4a67c354-55e9-4f42-bda3-35d16bf192db on user Apr 12 01:00:33 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] Creating event network-changed:d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance 4a67c354-55e9-4f42-bda3-35d16bf192db on user Apr 12 01:00:33 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] Creating event network-vif-plugged:d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance 4a67c354-55e9-4f42-bda3-35d16bf192db on user Apr 12 01:00:33 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] Creating event network-vif-plugged:d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance 4a67c354-55e9-4f42-bda3-35d16bf192db on user Apr 12 01:00:33 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] Creating event network-vif-plugged:d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance 4a67c354-55e9-4f42-bda3-35d16bf192db on user Apr 12 01:00:33 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-27fdf23b-2aa4-49af-ab8e-da61f12f7252 req-19ae90ec-1367-4712-98a8-8086470dc08e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 859 microversion: 2.1 time: 0.035922 Apr 12 01:00:33 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 349/1043] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:00:33 2023] POST /compute/v2.1/os-server-external-events => generated 859 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:00:35 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-794cb782-6fa3-42b8-945b-5d48f16a3c59 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:00:35 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-794cb782-6fa3-42b8-945b-5d48f16a3c59 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:00:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-794cb782-6fa3-42b8-945b-5d48f16a3c59 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:00:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-794cb782-6fa3-42b8-945b-5d48f16a3c59 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:00:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-794cb782-6fa3-42b8-945b-5d48f16a3c59 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:00:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-794cb782-6fa3-42b8-945b-5d48f16a3c59 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:00:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-794cb782-6fa3-42b8-945b-5d48f16a3c59 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:00:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-794cb782-6fa3-42b8-945b-5d48f16a3c59 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:00:35 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-794cb782-6fa3-42b8-945b-5d48f16a3c59 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057464 Apr 12 01:00:35 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 346/1044] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 01:00:35 2023] GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 01:00:35 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:00:35 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:00:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:00:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:00:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:00:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:00:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:00:35 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:00:35 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Going to try to terminate instance {{(pid=72494) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 01:00:35 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-faf44426-d1ec-42d1-b3b1-a7ab227dea72 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608" status: 204 len: 0 microversion: 2.20 time: 0.118457 Apr 12 01:00:35 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 350/1045] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 01:00:35 2023] DELETE /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 01:00:35 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-1eec122f-9507-4c42-aa8c-62f0213f39af tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:00:35 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-1eec122f-9507-4c42-aa8c-62f0213f39af tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:00:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1eec122f-9507-4c42-aa8c-62f0213f39af tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:00:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1eec122f-9507-4c42-aa8c-62f0213f39af tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:00:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1eec122f-9507-4c42-aa8c-62f0213f39af tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:00:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1eec122f-9507-4c42-aa8c-62f0213f39af tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:00:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1eec122f-9507-4c42-aa8c-62f0213f39af tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:00:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-1eec122f-9507-4c42-aa8c-62f0213f39af tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:00:36 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-1eec122f-9507-4c42-aa8c-62f0213f39af tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 01:00:36 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-1eec122f-9507-4c42-aa8c-62f0213f39af tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 01:00:36 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-1eec122f-9507-4c42-aa8c-62f0213f39af tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '418881a7e56e4c19bbf900ef71029ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26d891933d647b7b27c75915fb726f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 01:00:36 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-1eec122f-9507-4c42-aa8c-62f0213f39af tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608" status: 200 len: 1713 microversion: 2.20 time: 0.189394 Apr 12 01:00:36 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 350/1046] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 01:00:35 2023] GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608 => generated 1713 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 01:00:36 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-bb4cbc57-3ab5-4d2f-893f-bb542ed2fa14 req-d43ea97d-19c6-482b-8284-0014a76e3ccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e24bbae-7697-4c46-9c68-48d8393da608", "name": "network-vif-unplugged", "status": "completed", "tag": "6c9e7810-9a63-4360-889c-edbd6af6ba4f"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:00:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-bb4cbc57-3ab5-4d2f-893f-bb542ed2fa14 req-d43ea97d-19c6-482b-8284-0014a76e3ccd service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:00:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-bb4cbc57-3ab5-4d2f-893f-bb542ed2fa14 req-d43ea97d-19c6-482b-8284-0014a76e3ccd service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:00:36 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-bb4cbc57-3ab5-4d2f-893f-bb542ed2fa14 req-d43ea97d-19c6-482b-8284-0014a76e3ccd service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:00:36 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-bb4cbc57-3ab5-4d2f-893f-bb542ed2fa14 req-d43ea97d-19c6-482b-8284-0014a76e3ccd service nova] Creating event network-vif-unplugged:6c9e7810-9a63-4360-889c-edbd6af6ba4f for instance 4e24bbae-7697-4c46-9c68-48d8393da608 on user Apr 12 01:00:36 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-bb4cbc57-3ab5-4d2f-893f-bb542ed2fa14 req-d43ea97d-19c6-482b-8284-0014a76e3ccd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032740 Apr 12 01:00:36 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 347/1047] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:00:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:00:38 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-6dba803b-4379-4ef9-a5b6-4d1e9fa6cf4e req-1d6ef884-44ef-4db0-afa4-41a4050d23f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e24bbae-7697-4c46-9c68-48d8393da608", "name": "network-vif-plugged", "status": "completed", "tag": "6c9e7810-9a63-4360-889c-edbd6af6ba4f"}, {"server_uuid": "4e24bbae-7697-4c46-9c68-48d8393da608", "name": "network-vif-deleted", "tag": "6c9e7810-9a63-4360-889c-edbd6af6ba4f"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:00:38 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-6dba803b-4379-4ef9-a5b6-4d1e9fa6cf4e req-1d6ef884-44ef-4db0-afa4-41a4050d23f4 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:00:38 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-6dba803b-4379-4ef9-a5b6-4d1e9fa6cf4e req-1d6ef884-44ef-4db0-afa4-41a4050d23f4 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:00:38 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-6dba803b-4379-4ef9-a5b6-4d1e9fa6cf4e req-1d6ef884-44ef-4db0-afa4-41a4050d23f4 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:00:38 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-6dba803b-4379-4ef9-a5b6-4d1e9fa6cf4e req-1d6ef884-44ef-4db0-afa4-41a4050d23f4 service nova] Creating event network-vif-plugged:6c9e7810-9a63-4360-889c-edbd6af6ba4f for instance 4e24bbae-7697-4c46-9c68-48d8393da608 on user Apr 12 01:00:38 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-6dba803b-4379-4ef9-a5b6-4d1e9fa6cf4e req-1d6ef884-44ef-4db0-afa4-41a4050d23f4 service nova] Creating event network-vif-deleted:6c9e7810-9a63-4360-889c-edbd6af6ba4f for instance 4e24bbae-7697-4c46-9c68-48d8393da608 on user Apr 12 01:00:38 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-6dba803b-4379-4ef9-a5b6-4d1e9fa6cf4e req-1d6ef884-44ef-4db0-afa4-41a4050d23f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035799 Apr 12 01:00:38 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 351/1048] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:00:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:01:03 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:01:03 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:01:03 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:01:03 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:01:03 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:01:03 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:01:03 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:01:03 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:01:03 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:01:03 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:01:03 user devstack@n-api.service[72496]: DEBUG nova.objects.instance [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lazy-loading 'services' on Instance uuid 4a67c354-55e9-4f42-bda3-35d16bf192db {{(pid=72496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 01:01:03 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-4c43bd44-6f16-4c73-a7ce-f41981a1f983 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db/os-volume_attachments/e40b29b9-23d9-4c1e-88f1-f95983dbe508" status: 202 len: 0 microversion: 2.1 time: 0.334227 Apr 12 01:01:03 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 351/1049] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 01:01:03 2023] DELETE /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db/os-volume_attachments/e40b29b9-23d9-4c1e-88f1-f95983dbe508 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 01:01:03 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-652772be-5be0-4b44-b686-d52bae6c716f tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:01:03 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-652772be-5be0-4b44-b686-d52bae6c716f tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:01:03 user devstack@n-api.service[72495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 01:01:03 user devstack@n-api.service[72495]: Wed Apr 12 01:01:03 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db/os-volume_attachments (ip 10.0.0.210) !!! Apr 12 01:01:03 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:01:03 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=12 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:01:03 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-652772be-5be0-4b44-b686-d52bae6c716f tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:01:03 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-652772be-5be0-4b44-b686-d52bae6c716f tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:01:03 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-652772be-5be0-4b44-b686-d52bae6c716f tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:01:03 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-652772be-5be0-4b44-b686-d52bae6c716f tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:01:03 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-652772be-5be0-4b44-b686-d52bae6c716f tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:01:03 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-652772be-5be0-4b44-b686-d52bae6c716f tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:01:03 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-652772be-5be0-4b44-b686-d52bae6c716f tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060270 Apr 12 01:01:03 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 348/1050] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 01:01:03 2023] GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:01:26 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:01:26 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:01:26 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-b21a6835-75f2-47ad-be92-2e6b75155b89 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:01:26 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-b21a6835-75f2-47ad-be92-2e6b75155b89 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:01:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b21a6835-75f2-47ad-be92-2e6b75155b89 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:01:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b21a6835-75f2-47ad-be92-2e6b75155b89 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:01:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b21a6835-75f2-47ad-be92-2e6b75155b89 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:01:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b21a6835-75f2-47ad-be92-2e6b75155b89 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:01:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b21a6835-75f2-47ad-be92-2e6b75155b89 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:01:26 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-b21a6835-75f2-47ad-be92-2e6b75155b89 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:01:26 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-b21a6835-75f2-47ad-be92-2e6b75155b89 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] HTTP exception thrown: Instance 4e24bbae-7697-4c46-9c68-48d8393da608 could not be found. Apr 12 01:01:26 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-b21a6835-75f2-47ad-be92-2e6b75155b89 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Request method failure captured: Apr 12 01:01:26 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608 HTTP/1.1 Apr 12 01:01:26 user devstack@n-api.service[72494]: Accept: application/json Apr 12 01:01:26 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 01:01:26 user devstack@n-api.service[72494]: Connection: close Apr 12 01:01:26 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 01:01:26 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 01:01:26 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 01:01:26 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 01:01:26 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 01:01:26 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNf-p5DHRzBNEyPvYkog6l4TYa8AiCIwFog1dykK5sKE0WJHvnMKjDSCkB5GSFSZs7AGZw0tRcc0GWzrFvhUcvgsOl7nkaoOc9K_SLD82QLyBIk61yigh2Eu4LWHDM-AmZJIuxIDL7rGcXsWkew6ZWa4nXxT648elHnjoZNRIC08lD2U Apr 12 01:01:26 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 01:01:26 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 01:01:26 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 01:01:26 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 01:01:26 user devstack@n-api.service[72494]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 01:01:26 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 01:01:26 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 01:01:26 user devstack@n-api.service[72494]: X-Project-Id: c26d891933d647b7b27c75915fb726f3 Apr 12 01:01:26 user devstack@n-api.service[72494]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1335687803 Apr 12 01:01:26 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 01:01:26 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 01:01:26 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c26d891933d647b7b27c75915fb726f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c26d891933d647b7b27c75915fb726f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c26d891933d647b7b27c75915fb726f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 01:01:26 user devstack@n-api.service[72494]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1335687803 Apr 12 01:01:26 user devstack@n-api.service[72494]: X-Tenant-Id: c26d891933d647b7b27c75915fb726f3 Apr 12 01:01:26 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1335687803 Apr 12 01:01:26 user devstack@n-api.service[72494]: X-User: tempest-AttachVolumeShelveTestJSON-1335687803-project-member Apr 12 01:01:26 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 01:01:26 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 01:01:26 user devstack@n-api.service[72494]: X-User-Id: 418881a7e56e4c19bbf900ef71029ce0 Apr 12 01:01:26 user devstack@n-api.service[72494]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1335687803-project-member Apr 12 01:01:26 user devstack@n-api.service[72494]: method: > Apr 12 01:01:26 user devstack@n-api.service[72494]: exception: Instance 4e24bbae-7697-4c46-9c68-48d8393da608 could not be found. Apr 12 01:01:26 user devstack@n-api.service[72494]: action_args: {'id': '4e24bbae-7697-4c46-9c68-48d8393da608'} Apr 12 01:01:26 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e24bbae-7697-4c46-9c68-48d8393da608 could not be found. Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e24bbae-7697-4c46-9c68-48d8393da608 could not be found. Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e24bbae-7697-4c46-9c68-48d8393da608 could not be found. Apr 12 01:01:26 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:01:26 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-b21a6835-75f2-47ad-be92-2e6b75155b89 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Returning 404 to user: Instance 4e24bbae-7697-4c46-9c68-48d8393da608 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 01:01:26 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-b21a6835-75f2-47ad-be92-2e6b75155b89 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608" status: 404 len: 111 microversion: 2.20 time: 0.042851 Apr 12 01:01:26 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 352/1051] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 01:01:26 2023] GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 12 01:01:26 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:01:26 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:01:26 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-5f7465e2-7139-4143-bb38-9f3477e65d94 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '.version_select at 0x7f7cd4672440>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:01:26 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-5f7465e2-7139-4143-bb38-9f3477e65d94 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-238651399" status: 204 len: 0 microversion: 2.20 time: 0.032834 Apr 12 01:01:26 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 352/1052] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 12 01:01:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-238651399 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 01:01:29 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-f68bbb63-8dcb-48db-9042-82c9c44eecee tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:01:29 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-f68bbb63-8dcb-48db-9042-82c9c44eecee tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:01:29 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:01:29 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:01:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-f68bbb63-8dcb-48db-9042-82c9c44eecee tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:01:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-f68bbb63-8dcb-48db-9042-82c9c44eecee tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:01:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-f68bbb63-8dcb-48db-9042-82c9c44eecee tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:01:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-f68bbb63-8dcb-48db-9042-82c9c44eecee tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:01:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-f68bbb63-8dcb-48db-9042-82c9c44eecee tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:01:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-f68bbb63-8dcb-48db-9042-82c9c44eecee tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:01:29 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-f68bbb63-8dcb-48db-9042-82c9c44eecee tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] HTTP exception thrown: Instance 4e24bbae-7697-4c46-9c68-48d8393da608 could not be found. Apr 12 01:01:29 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-f68bbb63-8dcb-48db-9042-82c9c44eecee tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Request method failure captured: Apr 12 01:01:29 user devstack@n-api.service[72495]: request: DELETE /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608 HTTP/1.1 Apr 12 01:01:29 user devstack@n-api.service[72495]: Accept: application/json Apr 12 01:01:29 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 01:01:29 user devstack@n-api.service[72495]: Connection: close Apr 12 01:01:29 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 01:01:29 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 01:01:29 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 01:01:29 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 01:01:29 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 01:01:29 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNf-p5DHRzBNEyPvYkog6l4TYa8AiCIwFog1dykK5sKE0WJHvnMKjDSCkB5GSFSZs7AGZw0tRcc0GWzrFvhUcvgsOl7nkaoOc9K_SLD82QLyBIk61yigh2Eu4LWHDM-AmZJIuxIDL7rGcXsWkew6ZWa4nXxT648elHnjoZNRIC08lD2U Apr 12 01:01:29 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 01:01:29 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 01:01:29 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 01:01:29 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 01:01:29 user devstack@n-api.service[72495]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 01:01:29 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 01:01:29 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 01:01:29 user devstack@n-api.service[72495]: X-Project-Id: c26d891933d647b7b27c75915fb726f3 Apr 12 01:01:29 user devstack@n-api.service[72495]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1335687803 Apr 12 01:01:29 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 01:01:29 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 01:01:29 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c26d891933d647b7b27c75915fb726f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c26d891933d647b7b27c75915fb726f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c26d891933d647b7b27c75915fb726f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 01:01:29 user devstack@n-api.service[72495]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1335687803 Apr 12 01:01:29 user devstack@n-api.service[72495]: X-Tenant-Id: c26d891933d647b7b27c75915fb726f3 Apr 12 01:01:29 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1335687803 Apr 12 01:01:29 user devstack@n-api.service[72495]: X-User: tempest-AttachVolumeShelveTestJSON-1335687803-project-member Apr 12 01:01:29 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 01:01:29 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 01:01:29 user devstack@n-api.service[72495]: X-User-Id: 418881a7e56e4c19bbf900ef71029ce0 Apr 12 01:01:29 user devstack@n-api.service[72495]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1335687803-project-member Apr 12 01:01:29 user devstack@n-api.service[72495]: method: > Apr 12 01:01:29 user devstack@n-api.service[72495]: exception: Instance 4e24bbae-7697-4c46-9c68-48d8393da608 could not be found. Apr 12 01:01:29 user devstack@n-api.service[72495]: action_args: {'id': '4e24bbae-7697-4c46-9c68-48d8393da608'} Apr 12 01:01:29 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e24bbae-7697-4c46-9c68-48d8393da608 could not be found. Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e24bbae-7697-4c46-9c68-48d8393da608 could not be found. Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e24bbae-7697-4c46-9c68-48d8393da608 could not be found. Apr 12 01:01:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:01:29 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-f68bbb63-8dcb-48db-9042-82c9c44eecee tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Returning 404 to user: Instance 4e24bbae-7697-4c46-9c68-48d8393da608 could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 01:01:29 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-f68bbb63-8dcb-48db-9042-82c9c44eecee tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608" status: 404 len: 111 microversion: 2.20 time: 0.034102 Apr 12 01:01:29 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 349/1053] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 01:01:29 2023] DELETE /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 01:01:29 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-5902d10e-818d-4883-b3d4-12efb3225e4c tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:01:29 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-5902d10e-818d-4883-b3d4-12efb3225e4c tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: 4e24bbae-7697-4c46-9c68-48d8393da608] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:01:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5902d10e-818d-4883-b3d4-12efb3225e4c tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:01:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5902d10e-818d-4883-b3d4-12efb3225e4c tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:01:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5902d10e-818d-4883-b3d4-12efb3225e4c tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:01:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5902d10e-818d-4883-b3d4-12efb3225e4c tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:01:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5902d10e-818d-4883-b3d4-12efb3225e4c tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:01:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-5902d10e-818d-4883-b3d4-12efb3225e4c tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:01:29 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-5902d10e-818d-4883-b3d4-12efb3225e4c tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] HTTP exception thrown: Instance 4e24bbae-7697-4c46-9c68-48d8393da608 could not be found. Apr 12 01:01:29 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-5902d10e-818d-4883-b3d4-12efb3225e4c tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Request method failure captured: Apr 12 01:01:29 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608 HTTP/1.1 Apr 12 01:01:29 user devstack@n-api.service[72494]: Accept: application/json Apr 12 01:01:29 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 01:01:29 user devstack@n-api.service[72494]: Connection: close Apr 12 01:01:29 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 01:01:29 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 01:01:29 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 01:01:29 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 01:01:29 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 01:01:29 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNf-p5DHRzBNEyPvYkog6l4TYa8AiCIwFog1dykK5sKE0WJHvnMKjDSCkB5GSFSZs7AGZw0tRcc0GWzrFvhUcvgsOl7nkaoOc9K_SLD82QLyBIk61yigh2Eu4LWHDM-AmZJIuxIDL7rGcXsWkew6ZWa4nXxT648elHnjoZNRIC08lD2U Apr 12 01:01:29 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 01:01:29 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 01:01:29 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 01:01:29 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 01:01:29 user devstack@n-api.service[72494]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 01:01:29 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 01:01:29 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 01:01:29 user devstack@n-api.service[72494]: X-Project-Id: c26d891933d647b7b27c75915fb726f3 Apr 12 01:01:29 user devstack@n-api.service[72494]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1335687803 Apr 12 01:01:29 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 01:01:29 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 01:01:29 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c26d891933d647b7b27c75915fb726f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c26d891933d647b7b27c75915fb726f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c26d891933d647b7b27c75915fb726f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 01:01:29 user devstack@n-api.service[72494]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1335687803 Apr 12 01:01:29 user devstack@n-api.service[72494]: X-Tenant-Id: c26d891933d647b7b27c75915fb726f3 Apr 12 01:01:29 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1335687803 Apr 12 01:01:29 user devstack@n-api.service[72494]: X-User: tempest-AttachVolumeShelveTestJSON-1335687803-project-member Apr 12 01:01:29 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 01:01:29 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 01:01:29 user devstack@n-api.service[72494]: X-User-Id: 418881a7e56e4c19bbf900ef71029ce0 Apr 12 01:01:29 user devstack@n-api.service[72494]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1335687803-project-member Apr 12 01:01:29 user devstack@n-api.service[72494]: method: > Apr 12 01:01:29 user devstack@n-api.service[72494]: exception: Instance 4e24bbae-7697-4c46-9c68-48d8393da608 could not be found. Apr 12 01:01:29 user devstack@n-api.service[72494]: action_args: {'id': '4e24bbae-7697-4c46-9c68-48d8393da608'} Apr 12 01:01:29 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e24bbae-7697-4c46-9c68-48d8393da608 could not be found. Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e24bbae-7697-4c46-9c68-48d8393da608 could not be found. Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e24bbae-7697-4c46-9c68-48d8393da608 could not be found. Apr 12 01:01:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:01:29 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-5902d10e-818d-4883-b3d4-12efb3225e4c tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Returning 404 to user: Instance 4e24bbae-7697-4c46-9c68-48d8393da608 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 01:01:29 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-5902d10e-818d-4883-b3d4-12efb3225e4c tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608" status: 404 len: 111 microversion: 2.20 time: 0.027221 Apr 12 01:01:29 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 353/1054] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 01:01:29 2023] GET /compute/v2.1/servers/4e24bbae-7697-4c46-9c68-48d8393da608 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 01:01:31 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-97306d29-3284-4cc1-8539-cb99b31ebfdd tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:01:31 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-97306d29-3284-4cc1-8539-cb99b31ebfdd tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:01:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-97306d29-3284-4cc1-8539-cb99b31ebfdd tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:01:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-97306d29-3284-4cc1-8539-cb99b31ebfdd tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:01:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-97306d29-3284-4cc1-8539-cb99b31ebfdd tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:01:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-97306d29-3284-4cc1-8539-cb99b31ebfdd tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:01:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-97306d29-3284-4cc1-8539-cb99b31ebfdd tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:01:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-97306d29-3284-4cc1-8539-cb99b31ebfdd tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:01:31 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-97306d29-3284-4cc1-8539-cb99b31ebfdd tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] HTTP exception thrown: Instance a4d163ed-7900-486c-8b96-101af5547580 could not be found. Apr 12 01:01:31 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-97306d29-3284-4cc1-8539-cb99b31ebfdd tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Request method failure captured: Apr 12 01:01:31 user devstack@n-api.service[72496]: request: DELETE /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580 HTTP/1.1 Apr 12 01:01:31 user devstack@n-api.service[72496]: Accept: application/json Apr 12 01:01:31 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 01:01:31 user devstack@n-api.service[72496]: Connection: close Apr 12 01:01:31 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 01:01:31 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 01:01:31 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 01:01:31 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 01:01:31 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 01:01:31 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNf-p5DHRzBNEyPvYkog6l4TYa8AiCIwFog1dykK5sKE0WJHvnMKjDSCkB5GSFSZs7AGZw0tRcc0GWzrFvhUcvgsOl7nkaoOc9K_SLD82QLyBIk61yigh2Eu4LWHDM-AmZJIuxIDL7rGcXsWkew6ZWa4nXxT648elHnjoZNRIC08lD2U Apr 12 01:01:31 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 01:01:31 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 01:01:31 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 01:01:31 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 01:01:31 user devstack@n-api.service[72496]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 01:01:31 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 01:01:31 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 01:01:31 user devstack@n-api.service[72496]: X-Project-Id: c26d891933d647b7b27c75915fb726f3 Apr 12 01:01:31 user devstack@n-api.service[72496]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1335687803 Apr 12 01:01:31 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 01:01:31 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 01:01:31 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c26d891933d647b7b27c75915fb726f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c26d891933d647b7b27c75915fb726f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c26d891933d647b7b27c75915fb726f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 01:01:31 user devstack@n-api.service[72496]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1335687803 Apr 12 01:01:31 user devstack@n-api.service[72496]: X-Tenant-Id: c26d891933d647b7b27c75915fb726f3 Apr 12 01:01:31 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1335687803 Apr 12 01:01:31 user devstack@n-api.service[72496]: X-User: tempest-AttachVolumeShelveTestJSON-1335687803-project-member Apr 12 01:01:31 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 01:01:31 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 01:01:31 user devstack@n-api.service[72496]: X-User-Id: 418881a7e56e4c19bbf900ef71029ce0 Apr 12 01:01:31 user devstack@n-api.service[72496]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1335687803-project-member Apr 12 01:01:31 user devstack@n-api.service[72496]: method: > Apr 12 01:01:31 user devstack@n-api.service[72496]: exception: Instance a4d163ed-7900-486c-8b96-101af5547580 could not be found. Apr 12 01:01:31 user devstack@n-api.service[72496]: action_args: {'id': 'a4d163ed-7900-486c-8b96-101af5547580'} Apr 12 01:01:31 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4d163ed-7900-486c-8b96-101af5547580 could not be found. Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4d163ed-7900-486c-8b96-101af5547580 could not be found. Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4d163ed-7900-486c-8b96-101af5547580 could not be found. Apr 12 01:01:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 01:01:31 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-97306d29-3284-4cc1-8539-cb99b31ebfdd tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Returning 404 to user: Instance a4d163ed-7900-486c-8b96-101af5547580 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 01:01:31 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-97306d29-3284-4cc1-8539-cb99b31ebfdd tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580" status: 404 len: 111 microversion: 2.20 time: 0.033257 Apr 12 01:01:31 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 353/1055] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 01:01:31 2023] DELETE /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 01:01:31 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-3280314e-48d6-4131-bb06-a15a16948987 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:01:31 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-3280314e-48d6-4131-bb06-a15a16948987 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] [instance: a4d163ed-7900-486c-8b96-101af5547580] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:01:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-3280314e-48d6-4131-bb06-a15a16948987 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:01:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-3280314e-48d6-4131-bb06-a15a16948987 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:01:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-3280314e-48d6-4131-bb06-a15a16948987 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:01:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-3280314e-48d6-4131-bb06-a15a16948987 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:01:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-3280314e-48d6-4131-bb06-a15a16948987 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:01:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-3280314e-48d6-4131-bb06-a15a16948987 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:01:31 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-3280314e-48d6-4131-bb06-a15a16948987 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] HTTP exception thrown: Instance a4d163ed-7900-486c-8b96-101af5547580 could not be found. Apr 12 01:01:31 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-3280314e-48d6-4131-bb06-a15a16948987 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Request method failure captured: Apr 12 01:01:31 user devstack@n-api.service[72495]: request: GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580 HTTP/1.1 Apr 12 01:01:31 user devstack@n-api.service[72495]: Accept: application/json Apr 12 01:01:31 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 01:01:31 user devstack@n-api.service[72495]: Connection: close Apr 12 01:01:31 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 01:01:31 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 01:01:31 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 01:01:31 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 01:01:31 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 01:01:31 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNf-p5DHRzBNEyPvYkog6l4TYa8AiCIwFog1dykK5sKE0WJHvnMKjDSCkB5GSFSZs7AGZw0tRcc0GWzrFvhUcvgsOl7nkaoOc9K_SLD82QLyBIk61yigh2Eu4LWHDM-AmZJIuxIDL7rGcXsWkew6ZWa4nXxT648elHnjoZNRIC08lD2U Apr 12 01:01:31 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 01:01:31 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 01:01:31 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 01:01:31 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 01:01:31 user devstack@n-api.service[72495]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 01:01:31 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 01:01:31 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 01:01:31 user devstack@n-api.service[72495]: X-Project-Id: c26d891933d647b7b27c75915fb726f3 Apr 12 01:01:31 user devstack@n-api.service[72495]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1335687803 Apr 12 01:01:31 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 01:01:31 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 01:01:31 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c26d891933d647b7b27c75915fb726f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c26d891933d647b7b27c75915fb726f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c26d891933d647b7b27c75915fb726f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 01:01:31 user devstack@n-api.service[72495]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1335687803 Apr 12 01:01:31 user devstack@n-api.service[72495]: X-Tenant-Id: c26d891933d647b7b27c75915fb726f3 Apr 12 01:01:31 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1335687803 Apr 12 01:01:31 user devstack@n-api.service[72495]: X-User: tempest-AttachVolumeShelveTestJSON-1335687803-project-member Apr 12 01:01:31 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 01:01:31 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 01:01:31 user devstack@n-api.service[72495]: X-User-Id: 418881a7e56e4c19bbf900ef71029ce0 Apr 12 01:01:31 user devstack@n-api.service[72495]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1335687803-project-member Apr 12 01:01:31 user devstack@n-api.service[72495]: method: > Apr 12 01:01:31 user devstack@n-api.service[72495]: exception: Instance a4d163ed-7900-486c-8b96-101af5547580 could not be found. Apr 12 01:01:31 user devstack@n-api.service[72495]: action_args: {'id': 'a4d163ed-7900-486c-8b96-101af5547580'} Apr 12 01:01:31 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4d163ed-7900-486c-8b96-101af5547580 could not be found. Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4d163ed-7900-486c-8b96-101af5547580 could not be found. Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4d163ed-7900-486c-8b96-101af5547580 could not be found. Apr 12 01:01:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:01:31 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-3280314e-48d6-4131-bb06-a15a16948987 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] Returning 404 to user: Instance a4d163ed-7900-486c-8b96-101af5547580 could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 01:01:31 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-3280314e-48d6-4131-bb06-a15a16948987 tempest-AttachVolumeShelveTestJSON-1335687803 tempest-AttachVolumeShelveTestJSON-1335687803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580" status: 404 len: 111 microversion: 2.20 time: 0.031799 Apr 12 01:01:31 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 350/1056] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 01:01:31 2023] GET /compute/v2.1/servers/a4d163ed-7900-486c-8b96-101af5547580 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 01:01:53 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-fc7218a7-0c41-4330-af71-4a7b7d477f38 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:01:53 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-fc7218a7-0c41-4330-af71-4a7b7d477f38 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:01:53 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=4 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:01:53 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=4 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:01:53 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fc7218a7-0c41-4330-af71-4a7b7d477f38 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:01:53 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fc7218a7-0c41-4330-af71-4a7b7d477f38 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:01:53 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fc7218a7-0c41-4330-af71-4a7b7d477f38 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:01:53 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fc7218a7-0c41-4330-af71-4a7b7d477f38 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:01:53 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fc7218a7-0c41-4330-af71-4a7b7d477f38 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:01:53 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fc7218a7-0c41-4330-af71-4a7b7d477f38 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:01:53 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-fc7218a7-0c41-4330-af71-4a7b7d477f38 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046603 Apr 12 01:01:53 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 354/1057] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 01:01:53 2023] GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 01:01:55 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-70fc0ca5-30c7-4f59-9647-a44c63d2c751 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Calling method '.version_select at 0x7f7cd4670a60>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:01:55 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:01:55 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:01:56 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-70fc0ca5-30c7-4f59-9647-a44c63d2c751 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/dfe86d03-a733-4f19-9cc7-56074698a841" status: 204 len: 0 microversion: 2.1 time: 0.238364 Apr 12 01:01:56 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 354/1058] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:01:55 2023] DELETE /compute/v2.1/images/dfe86d03-a733-4f19-9cc7-56074698a841 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 01:01:56 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:01:56 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:01:56 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:01:56 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:01:56 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:01:56 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:01:56 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:01:56 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:01:56 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:01:56 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:01:56 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Going to try to terminate instance {{(pid=72495) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 01:01:56 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-d59d6e1f-b544-4541-9e5b-a5ca7ce581b0 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db" status: 204 len: 0 microversion: 2.1 time: 0.138730 Apr 12 01:01:56 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 351/1059] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 01:01:56 2023] DELETE /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 12 01:01:56 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-89e8d2de-6009-4cef-8d94-613ba6ff9054 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:01:56 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-89e8d2de-6009-4cef-8d94-613ba6ff9054 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:01:56 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-89e8d2de-6009-4cef-8d94-613ba6ff9054 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:01:56 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-89e8d2de-6009-4cef-8d94-613ba6ff9054 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:01:56 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-89e8d2de-6009-4cef-8d94-613ba6ff9054 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:01:56 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-89e8d2de-6009-4cef-8d94-613ba6ff9054 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:01:56 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-89e8d2de-6009-4cef-8d94-613ba6ff9054 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:01:56 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-89e8d2de-6009-4cef-8d94-613ba6ff9054 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:01:56 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-d0d85d2f-2ecf-416e-82fd-a68503d343d1 req-b15f30f1-2e88-45b3-ae25-6ed411cf2bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a67c354-55e9-4f42-bda3-35d16bf192db", "name": "network-vif-unplugged", "status": "completed", "tag": "d04a1887-8740-4c6c-a7b6-5e9e395ced98"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:01:56 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d0d85d2f-2ecf-416e-82fd-a68503d343d1 req-b15f30f1-2e88-45b3-ae25-6ed411cf2bf8 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:01:56 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d0d85d2f-2ecf-416e-82fd-a68503d343d1 req-b15f30f1-2e88-45b3-ae25-6ed411cf2bf8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:01:56 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d0d85d2f-2ecf-416e-82fd-a68503d343d1 req-b15f30f1-2e88-45b3-ae25-6ed411cf2bf8 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:01:56 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-d0d85d2f-2ecf-416e-82fd-a68503d343d1 req-b15f30f1-2e88-45b3-ae25-6ed411cf2bf8 service nova] Creating event network-vif-unplugged:d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance 4a67c354-55e9-4f42-bda3-35d16bf192db on user Apr 12 01:01:56 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-d0d85d2f-2ecf-416e-82fd-a68503d343d1 req-b15f30f1-2e88-45b3-ae25-6ed411cf2bf8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102566 Apr 12 01:01:56 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 355/1060] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:01:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:01:56 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-89e8d2de-6009-4cef-8d94-613ba6ff9054 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aedb8da82a64bdcaeff07c649f05379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ca08eae6134a639c5f532e0742b3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 01:01:56 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-89e8d2de-6009-4cef-8d94-613ba6ff9054 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db" status: 200 len: 1677 microversion: 2.1 time: 0.520498 Apr 12 01:01:56 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 355/1061] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:01:56 2023] GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db => generated 1677 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 01:01:58 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-8fc8daa4-f39a-457f-abd5-1e071fa0dab3 req-1526dddf-7d31-4fe1-8f20-c1f379e25e6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a67c354-55e9-4f42-bda3-35d16bf192db", "name": "network-vif-deleted", "tag": "d04a1887-8740-4c6c-a7b6-5e9e395ced98"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:01:58 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8fc8daa4-f39a-457f-abd5-1e071fa0dab3 req-1526dddf-7d31-4fe1-8f20-c1f379e25e6e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:01:58 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8fc8daa4-f39a-457f-abd5-1e071fa0dab3 req-1526dddf-7d31-4fe1-8f20-c1f379e25e6e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:01:58 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8fc8daa4-f39a-457f-abd5-1e071fa0dab3 req-1526dddf-7d31-4fe1-8f20-c1f379e25e6e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:01:58 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-8fc8daa4-f39a-457f-abd5-1e071fa0dab3 req-1526dddf-7d31-4fe1-8f20-c1f379e25e6e service nova] Creating event network-vif-deleted:d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance 4a67c354-55e9-4f42-bda3-35d16bf192db on user Apr 12 01:01:58 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-8fc8daa4-f39a-457f-abd5-1e071fa0dab3 req-1526dddf-7d31-4fe1-8f20-c1f379e25e6e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087348 Apr 12 01:01:58 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 352/1062] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:01:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:01:58 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-2ad4edb3-a6fb-4914-bec4-5c84da07f7fc req-9c4e4ddb-3e11-4111-a334-2b7da29ca543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a67c354-55e9-4f42-bda3-35d16bf192db", "name": "network-vif-plugged", "status": "completed", "tag": "d04a1887-8740-4c6c-a7b6-5e9e395ced98"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:01:58 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2ad4edb3-a6fb-4914-bec4-5c84da07f7fc req-9c4e4ddb-3e11-4111-a334-2b7da29ca543 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:01:58 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2ad4edb3-a6fb-4914-bec4-5c84da07f7fc req-9c4e4ddb-3e11-4111-a334-2b7da29ca543 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:01:58 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2ad4edb3-a6fb-4914-bec4-5c84da07f7fc req-9c4e4ddb-3e11-4111-a334-2b7da29ca543 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:01:58 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-2ad4edb3-a6fb-4914-bec4-5c84da07f7fc req-9c4e4ddb-3e11-4111-a334-2b7da29ca543 service nova] Creating event network-vif-plugged:d04a1887-8740-4c6c-a7b6-5e9e395ced98 for instance 4a67c354-55e9-4f42-bda3-35d16bf192db on user Apr 12 01:01:58 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-2ad4edb3-a6fb-4914-bec4-5c84da07f7fc req-9c4e4ddb-3e11-4111-a334-2b7da29ca543 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045777 Apr 12 01:01:58 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 356/1063] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:01:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:02:14 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-99803033", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "networks": [{"uuid": "d7d7d428-1112-4a7b-bddd-0b8ff59971d8"}]}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:02:14 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=4 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:02:14 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=12 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:02:14 user devstack@n-api.service[72494]: DEBUG nova.network.neutron [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] validate_networks() for [('d7d7d428-1112-4a7b-bddd-0b8ff59971d8', None, None, None, None, None)] {{(pid=72494) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 01:02:14 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Flavor limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 01:02:14 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Image limits 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 01:02:14 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Flavor pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 01:02:14 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Image pref 0:0:0 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 01:02:14 user devstack@n-api.service[72494]: DEBUG nova.virt.hardware [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72494) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 01:02:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:02:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:02:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:02:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:02:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:02:14 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:02:14 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Getting quotas for project 8b090dd726e44a978a41caedb16a9737. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 01:02:14 user devstack@n-api.service[72494]: DEBUG nova.quota [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Getting quotas for user 37e45c15a3f348ec9862056beb628049 and project 8b090dd726e44a978a41caedb16a9737. Resources: {'ram', 'cores', 'instances'} {{(pid=72494) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 01:02:14 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Going to run 1 instances... {{(pid=72494) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 01:02:14 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72494) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 01:02:14 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-fea14019-33f5-451e-bd48-19331e7a7033 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.525005 Apr 12 01:02:14 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 356/1064] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 01:02:14 2023] POST /compute/v2.1/servers => generated 378 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 01:02:14 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:02:14 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:02:14 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-5825f010-e173-4be5-bab1-4457207cafdf tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:02:14 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-5825f010-e173-4be5-bab1-4457207cafdf tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:02:14 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-5825f010-e173-4be5-bab1-4457207cafdf tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e45c15a3f348ec9862056beb628049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b090dd726e44a978a41caedb16a9737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 01:02:14 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-5825f010-e173-4be5-bab1-4457207cafdf tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c797729d-b48e-4614-a47c-47ad714e78f1" status: 200 len: 1211 microversion: 2.1 time: 0.184233 Apr 12 01:02:14 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 353/1065] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:02:14 2023] GET /compute/v2.1/servers/c797729d-b48e-4614-a47c-47ad714e78f1 => generated 1211 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 01:02:17 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:02:17 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:02:17 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-8218eb1b-3926-4d40-a62e-cbfb1539e780 req-39cdccc2-7825-44af-9642-a1251442c75f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c797729d-b48e-4614-a47c-47ad714e78f1", "tag": "dd8d7486-ceab-40ab-968e-58a3bfeafb25"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:02:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-8218eb1b-3926-4d40-a62e-cbfb1539e780 req-39cdccc2-7825-44af-9642-a1251442c75f service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:02:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-8218eb1b-3926-4d40-a62e-cbfb1539e780 req-39cdccc2-7825-44af-9642-a1251442c75f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:02:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-8218eb1b-3926-4d40-a62e-cbfb1539e780 req-39cdccc2-7825-44af-9642-a1251442c75f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:02:17 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-8218eb1b-3926-4d40-a62e-cbfb1539e780 req-39cdccc2-7825-44af-9642-a1251442c75f service nova] Creating event network-changed:dd8d7486-ceab-40ab-968e-58a3bfeafb25 for instance c797729d-b48e-4614-a47c-47ad714e78f1 on user Apr 12 01:02:17 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-8218eb1b-3926-4d40-a62e-cbfb1539e780 req-39cdccc2-7825-44af-9642-a1251442c75f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040426 Apr 12 01:02:17 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 357/1066] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:02:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:02:19 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-fe5b1a86-8237-4f98-9d6e-f8fdc6c48680 req-2663435f-71fc-4b86-a0da-1ecb02fbb787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c797729d-b48e-4614-a47c-47ad714e78f1", "name": "network-vif-plugged", "status": "completed", "tag": "dd8d7486-ceab-40ab-968e-58a3bfeafb25"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:02:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-fe5b1a86-8237-4f98-9d6e-f8fdc6c48680 req-2663435f-71fc-4b86-a0da-1ecb02fbb787 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:02:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-fe5b1a86-8237-4f98-9d6e-f8fdc6c48680 req-2663435f-71fc-4b86-a0da-1ecb02fbb787 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:02:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-fe5b1a86-8237-4f98-9d6e-f8fdc6c48680 req-2663435f-71fc-4b86-a0da-1ecb02fbb787 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:02:19 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-fe5b1a86-8237-4f98-9d6e-f8fdc6c48680 req-2663435f-71fc-4b86-a0da-1ecb02fbb787 service nova] Creating event network-vif-plugged:dd8d7486-ceab-40ab-968e-58a3bfeafb25 for instance c797729d-b48e-4614-a47c-47ad714e78f1 on user Apr 12 01:02:19 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-fe5b1a86-8237-4f98-9d6e-f8fdc6c48680 req-2663435f-71fc-4b86-a0da-1ecb02fbb787 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028943 Apr 12 01:02:19 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 357/1067] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:02:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:02:21 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-3e6f11b3-592a-48a9-b8e8-5a50d0665be9 req-3ba5e330-95ca-4a95-9814-32c67bd38170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c797729d-b48e-4614-a47c-47ad714e78f1", "name": "network-vif-plugged", "status": "completed", "tag": "dd8d7486-ceab-40ab-968e-58a3bfeafb25"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:02:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3e6f11b3-592a-48a9-b8e8-5a50d0665be9 req-3ba5e330-95ca-4a95-9814-32c67bd38170 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:02:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3e6f11b3-592a-48a9-b8e8-5a50d0665be9 req-3ba5e330-95ca-4a95-9814-32c67bd38170 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:02:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-3e6f11b3-592a-48a9-b8e8-5a50d0665be9 req-3ba5e330-95ca-4a95-9814-32c67bd38170 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:02:21 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-3e6f11b3-592a-48a9-b8e8-5a50d0665be9 req-3ba5e330-95ca-4a95-9814-32c67bd38170 service nova] Creating event network-vif-plugged:dd8d7486-ceab-40ab-968e-58a3bfeafb25 for instance c797729d-b48e-4614-a47c-47ad714e78f1 on user Apr 12 01:02:21 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-3e6f11b3-592a-48a9-b8e8-5a50d0665be9 req-3ba5e330-95ca-4a95-9814-32c67bd38170 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036250 Apr 12 01:02:21 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 354/1068] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:02:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:02:46 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:02:46 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:02:46 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-cac4e84f-e9d1-4688-9122-1e65e05fb5d7 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:02:46 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-cac4e84f-e9d1-4688-9122-1e65e05fb5d7 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] [instance: 4a67c354-55e9-4f42-bda3-35d16bf192db] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:02:46 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-cac4e84f-e9d1-4688-9122-1e65e05fb5d7 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:02:46 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-cac4e84f-e9d1-4688-9122-1e65e05fb5d7 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:02:46 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-cac4e84f-e9d1-4688-9122-1e65e05fb5d7 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:02:46 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-cac4e84f-e9d1-4688-9122-1e65e05fb5d7 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:02:46 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-cac4e84f-e9d1-4688-9122-1e65e05fb5d7 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:02:46 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-cac4e84f-e9d1-4688-9122-1e65e05fb5d7 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:02:46 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-cac4e84f-e9d1-4688-9122-1e65e05fb5d7 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] HTTP exception thrown: Instance 4a67c354-55e9-4f42-bda3-35d16bf192db could not be found. Apr 12 01:02:46 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-cac4e84f-e9d1-4688-9122-1e65e05fb5d7 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Request method failure captured: Apr 12 01:02:46 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db HTTP/1.1 Apr 12 01:02:46 user devstack@n-api.service[72496]: Accept: application/json Apr 12 01:02:46 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 01:02:46 user devstack@n-api.service[72496]: Connection: close Apr 12 01:02:46 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 01:02:46 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 01:02:46 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 01:02:46 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 01:02:46 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 01:02:46 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNgFV4HVQC-HYnMrV-C1OhtcxneuQwMkheFI2t_d5vf_mHAR-luxL6CYhFrcZ1R4wsSScvOvSksgpb0GCN7ru_g8_UUuL2OVHhuVcm11DCiUfCa1UP7STswB70XsBPDsoT4o6dpnGZ5mJQ1Lzy-OMWAL0T14diu4lDNePrMqVGN1z9IM Apr 12 01:02:46 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 01:02:46 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 01:02:46 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 01:02:46 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 01:02:46 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 01:02:46 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 01:02:46 user devstack@n-api.service[72496]: X-Project-Id: 21ca08eae6134a639c5f532e0742b3a2 Apr 12 01:02:46 user devstack@n-api.service[72496]: X-Project-Name: tempest-ServerStableDeviceRescueTest-2039136793 Apr 12 01:02:46 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 01:02:46 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 01:02:46 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/21ca08eae6134a639c5f532e0742b3a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/21ca08eae6134a639c5f532e0742b3a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/21ca08eae6134a639c5f532e0742b3a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 01:02:46 user devstack@n-api.service[72496]: X-Tenant: tempest-ServerStableDeviceRescueTest-2039136793 Apr 12 01:02:46 user devstack@n-api.service[72496]: X-Tenant-Id: 21ca08eae6134a639c5f532e0742b3a2 Apr 12 01:02:46 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-2039136793 Apr 12 01:02:46 user devstack@n-api.service[72496]: X-User: tempest-ServerStableDeviceRescueTest-2039136793-project-member Apr 12 01:02:46 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 01:02:46 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 01:02:46 user devstack@n-api.service[72496]: X-User-Id: 7aedb8da82a64bdcaeff07c649f05379 Apr 12 01:02:46 user devstack@n-api.service[72496]: X-User-Name: tempest-ServerStableDeviceRescueTest-2039136793-project-member Apr 12 01:02:46 user devstack@n-api.service[72496]: method: > Apr 12 01:02:46 user devstack@n-api.service[72496]: exception: Instance 4a67c354-55e9-4f42-bda3-35d16bf192db could not be found. Apr 12 01:02:46 user devstack@n-api.service[72496]: action_args: {'id': '4a67c354-55e9-4f42-bda3-35d16bf192db'} Apr 12 01:02:46 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a67c354-55e9-4f42-bda3-35d16bf192db could not be found. Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a67c354-55e9-4f42-bda3-35d16bf192db could not be found. Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a67c354-55e9-4f42-bda3-35d16bf192db could not be found. Apr 12 01:02:46 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 01:02:46 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-cac4e84f-e9d1-4688-9122-1e65e05fb5d7 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Returning 404 to user: Instance 4a67c354-55e9-4f42-bda3-35d16bf192db could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 01:02:46 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-cac4e84f-e9d1-4688-9122-1e65e05fb5d7 tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db" status: 404 len: 111 microversion: 2.1 time: 0.037382 Apr 12 01:02:46 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 358/1069] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:02:46 2023] GET /compute/v2.1/servers/4a67c354-55e9-4f42-bda3-35d16bf192db => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 01:02:46 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:02:46 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=6 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:02:46 user devstack@n-api.service[72494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 01:02:46 user devstack@n-api.service[72494]: Wed Apr 12 01:02:46 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1824777377 (ip 10.0.0.210) !!! Apr 12 01:02:46 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:02:46 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=4 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:02:46 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-2148875e-be21-48f4-8562-ea3b38f766ca tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] Calling method '.version_select at 0x7f7cd489c9d0>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:02:46 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-2148875e-be21-48f4-8562-ea3b38f766ca tempest-ServerStableDeviceRescueTest-2039136793 tempest-ServerStableDeviceRescueTest-2039136793-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1824777377" status: 202 len: 0 microversion: 2.1 time: 0.044930 Apr 12 01:02:46 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 358/1070] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 01:02:46 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1824777377 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 01:02:57 user devstack@n-api.service[72495]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d204f24b-50e4-4145-ba20-980194a55823] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 01:02:57 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:02:57 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:02:57 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:02:57 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-0aa50cbb-1f67-4475-86f3-215d22bba5ad tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Action: 'create', calling method: .version_select at 0x7f7cd454a9e0>, body: {"keypair": {"name": "tempest-keypair-405999562", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHBVQjwvXMAL2ZlBLKytycGko75E+RSy9vx8tekCEhx+KKO5WnkWSWfow4mXiEDokmcy9WNMgokIUMM/mR9MIWVYabSiCWJvAdyrnCpPZvQbEoch6b2T3TWIyhnpcMBYg=="}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:02:57 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-0aa50cbb-1f67-4475-86f3-215d22bba5ad tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Getting quotas for project 8c9933281dea437cbaae1040fa06ff06. Resources: {'key_pairs'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 01:02:57 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-0aa50cbb-1f67-4475-86f3-215d22bba5ad tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Getting quotas for user bc8bacd3b6194651bc5820c3221ed45e and project 8c9933281dea437cbaae1040fa06ff06. Resources: {'key_pairs'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 01:02:57 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-0aa50cbb-1f67-4475-86f3-215d22bba5ad tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.180740 Apr 12 01:02:57 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 355/1071] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 01:02:57 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:02:58 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1063618078", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "82994dcf-29f7-4699-a7ae-6ea95516c04f"}], "security_groups": [{"name": "tempest-securitygroup--1401903350"}], "key_name": "tempest-keypair-405999562", "user_data": "}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:02:58 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:02:58 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:02:58 user devstack@n-api.service[72496]: DEBUG nova.network.neutron [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] validate_networks() for [('82994dcf-29f7-4699-a7ae-6ea95516c04f', None, None, None, None, None)] {{(pid=72496) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 01:02:59 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Flavor limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 01:02:59 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Image limits 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 01:02:59 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Flavor pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 01:02:59 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Image pref 0:0:0 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 01:02:59 user devstack@n-api.service[72496]: DEBUG nova.virt.hardware [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 01:02:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:02:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:02:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:02:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:02:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:02:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:02:59 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Getting quotas for project 8c9933281dea437cbaae1040fa06ff06. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 01:02:59 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Getting quotas for user bc8bacd3b6194651bc5820c3221ed45e and project 8c9933281dea437cbaae1040fa06ff06. Resources: {'ram', 'cores', 'instances'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 01:02:59 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Going to run 1 instances... {{(pid=72496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 01:02:59 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 01:02:59 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-c837ebc5-d9b7-47b5-8928-f86a8bf35d48 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.568471 Apr 12 01:02:59 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 359/1072] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 01:02:58 2023] POST /compute/v2.1/servers => generated 400 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 01:02:59 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:02:59 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-ed6a7917-08be-4f4f-a3e1-9afc6def1e8a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:02:59 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-ed6a7917-08be-4f4f-a3e1-9afc6def1e8a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:02:59 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-ed6a7917-08be-4f4f-a3e1-9afc6def1e8a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8bacd3b6194651bc5820c3221ed45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9933281dea437cbaae1040fa06ff06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 01:02:59 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-ed6a7917-08be-4f4f-a3e1-9afc6def1e8a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb" status: 200 len: 1231 microversion: 2.1 time: 0.070541 Apr 12 01:02:59 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 359/1073] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:02:59 2023] GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb => generated 1231 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 01:03:01 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-ed8c52de-27d8-4222-957b-02d70bfc8f56 req-69892df2-d816-4942-a17a-222ea2d9a12e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d751ef5-bdbe-4b26-9499-5e17b63de0bb", "tag": "bcdd6d2c-9283-4da8-b5b7-7f4311803431"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:03:01 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-ed8c52de-27d8-4222-957b-02d70bfc8f56 req-69892df2-d816-4942-a17a-222ea2d9a12e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:03:01 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-ed8c52de-27d8-4222-957b-02d70bfc8f56 req-69892df2-d816-4942-a17a-222ea2d9a12e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:03:01 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-ed8c52de-27d8-4222-957b-02d70bfc8f56 req-69892df2-d816-4942-a17a-222ea2d9a12e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:03:01 user devstack@n-api.service[72495]: INFO oslo.messaging._drivers.impl_rabbit [-] [d204f24b-50e4-4145-ba20-980194a55823] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 48690. Apr 12 01:03:01 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-ed8c52de-27d8-4222-957b-02d70bfc8f56 req-69892df2-d816-4942-a17a-222ea2d9a12e service nova] Creating event network-changed:bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb on user Apr 12 01:03:01 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-ed8c52de-27d8-4222-957b-02d70bfc8f56 req-69892df2-d816-4942-a17a-222ea2d9a12e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033286 Apr 12 01:03:01 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 356/1074] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:03:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:03:03 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-709ea198-aa98-488b-b48d-33230049589f req-fb72517b-0e3a-4ce0-86cd-dd6af6b58157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d751ef5-bdbe-4b26-9499-5e17b63de0bb", "name": "network-vif-plugged", "status": "completed", "tag": "bcdd6d2c-9283-4da8-b5b7-7f4311803431"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:03:03 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-709ea198-aa98-488b-b48d-33230049589f req-fb72517b-0e3a-4ce0-86cd-dd6af6b58157 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:03:03 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-709ea198-aa98-488b-b48d-33230049589f req-fb72517b-0e3a-4ce0-86cd-dd6af6b58157 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:03:03 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-709ea198-aa98-488b-b48d-33230049589f req-fb72517b-0e3a-4ce0-86cd-dd6af6b58157 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:03:03 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-709ea198-aa98-488b-b48d-33230049589f req-fb72517b-0e3a-4ce0-86cd-dd6af6b58157 service nova] Creating event network-vif-plugged:bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb on user Apr 12 01:03:03 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-709ea198-aa98-488b-b48d-33230049589f req-fb72517b-0e3a-4ce0-86cd-dd6af6b58157 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050964 Apr 12 01:03:03 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 360/1075] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:03:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:03:04 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-4b485d5d-64db-47da-a2c6-ccd152366932 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:03:04 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-4b485d5d-64db-47da-a2c6-ccd152366932 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:03:04 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4b485d5d-64db-47da-a2c6-ccd152366932 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:03:04 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4b485d5d-64db-47da-a2c6-ccd152366932 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:03:04 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4b485d5d-64db-47da-a2c6-ccd152366932 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:03:04 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4b485d5d-64db-47da-a2c6-ccd152366932 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:03:04 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4b485d5d-64db-47da-a2c6-ccd152366932 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:03:04 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-4b485d5d-64db-47da-a2c6-ccd152366932 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:03:05 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-4b485d5d-64db-47da-a2c6-ccd152366932 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e45c15a3f348ec9862056beb628049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b090dd726e44a978a41caedb16a9737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 01:03:05 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-4b485d5d-64db-47da-a2c6-ccd152366932 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c797729d-b48e-4614-a47c-47ad714e78f1" status: 200 len: 1494 microversion: 2.1 time: 0.140108 Apr 12 01:03:05 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 360/1076] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:03:04 2023] GET /compute/v2.1/servers/c797729d-b48e-4614-a47c-47ad714e78f1 => generated 1494 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 01:03:05 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-f8f99e7e-be1f-40a2-b38d-ba0945ebc272 req-55558ecc-6ae7-49cb-81f0-5dd88550aae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d751ef5-bdbe-4b26-9499-5e17b63de0bb", "name": "network-vif-plugged", "status": "completed", "tag": "bcdd6d2c-9283-4da8-b5b7-7f4311803431"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:03:05 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-f8f99e7e-be1f-40a2-b38d-ba0945ebc272 req-55558ecc-6ae7-49cb-81f0-5dd88550aae6 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:03:05 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-f8f99e7e-be1f-40a2-b38d-ba0945ebc272 req-55558ecc-6ae7-49cb-81f0-5dd88550aae6 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:03:05 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-f8f99e7e-be1f-40a2-b38d-ba0945ebc272 req-55558ecc-6ae7-49cb-81f0-5dd88550aae6 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:03:05 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-f8f99e7e-be1f-40a2-b38d-ba0945ebc272 req-55558ecc-6ae7-49cb-81f0-5dd88550aae6 service nova] Creating event network-vif-plugged:bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb on user Apr 12 01:03:05 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-f8f99e7e-be1f-40a2-b38d-ba0945ebc272 req-55558ecc-6ae7-49cb-81f0-5dd88550aae6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031351 Apr 12 01:03:05 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 357/1077] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:03:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:03:49 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:03:49 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:03:49 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:03:49 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:03:49 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-0b4b59c8-0567-4d75-a15e-4f1b3048b957 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:03:49 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-0b4b59c8-0567-4d75-a15e-4f1b3048b957 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:03:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0b4b59c8-0567-4d75-a15e-4f1b3048b957 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:03:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0b4b59c8-0567-4d75-a15e-4f1b3048b957 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:03:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0b4b59c8-0567-4d75-a15e-4f1b3048b957 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:03:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0b4b59c8-0567-4d75-a15e-4f1b3048b957 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:03:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0b4b59c8-0567-4d75-a15e-4f1b3048b957 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:03:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0b4b59c8-0567-4d75-a15e-4f1b3048b957 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:03:49 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-0b4b59c8-0567-4d75-a15e-4f1b3048b957 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8bacd3b6194651bc5820c3221ed45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9933281dea437cbaae1040fa06ff06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 01:03:49 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-0b4b59c8-0567-4d75-a15e-4f1b3048b957 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb" status: 200 len: 1537 microversion: 2.1 time: 0.170836 Apr 12 01:03:49 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 361/1078] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:03:49 2023] GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb => generated 1537 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 01:04:05 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:04:05 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=6 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:04:05 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=6 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:04:05 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce9ed676-aba1-4c55-ad93-97cd0a68384d", "device": "/dev/vdb"}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:04:05 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:04:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:04:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:04:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:04:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:04:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:04:05 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:04:05 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-0f1a5e52-b77d-4dd4-ba8c-2ce6f986102f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c797729d-b48e-4614-a47c-47ad714e78f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318999 Apr 12 01:04:05 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 361/1079] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 01:04:05 2023] POST /compute/v2.1/servers/c797729d-b48e-4614-a47c-47ad714e78f1/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:04:18 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:04:18 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:04:18 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:04:18 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:04:18 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:04:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:04:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:04:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:04:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:04:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:04:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:04:19 user devstack@n-api.service[72495]: DEBUG nova.objects.instance [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lazy-loading 'services' on Instance uuid c797729d-b48e-4614-a47c-47ad714e78f1 {{(pid=72495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 01:04:19 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-fb8e19c8-0e35-4b5c-a507-2157c9cf4d75 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c797729d-b48e-4614-a47c-47ad714e78f1/os-volume_attachments/ce9ed676-aba1-4c55-ad93-97cd0a68384d" status: 202 len: 0 microversion: 2.1 time: 0.184713 Apr 12 01:04:19 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 358/1080] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 01:04:18 2023] DELETE /compute/v2.1/servers/c797729d-b48e-4614-a47c-47ad714e78f1/os-volume_attachments/ce9ed676-aba1-4c55-ad93-97cd0a68384d => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 01:04:19 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:04:19 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:04:19 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:04:19 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:04:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:04:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:04:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:04:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:04:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:04:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:04:19 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Going to try to terminate instance {{(pid=72496) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 01:04:19 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-c13c54ee-78a6-44fe-af65-941c53fbfc58 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c797729d-b48e-4614-a47c-47ad714e78f1" status: 204 len: 0 microversion: 2.1 time: 0.151128 Apr 12 01:04:19 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 362/1081] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 01:04:19 2023] DELETE /compute/v2.1/servers/c797729d-b48e-4614-a47c-47ad714e78f1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 01:04:19 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:04:19 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:04:19 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-7e57448e-d0cc-43bd-bd97-b0a6863671eb tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:04:19 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-7e57448e-d0cc-43bd-bd97-b0a6863671eb tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:04:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7e57448e-d0cc-43bd-bd97-b0a6863671eb tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:04:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7e57448e-d0cc-43bd-bd97-b0a6863671eb tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:04:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7e57448e-d0cc-43bd-bd97-b0a6863671eb tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:04:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7e57448e-d0cc-43bd-bd97-b0a6863671eb tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:04:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7e57448e-d0cc-43bd-bd97-b0a6863671eb tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:04:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7e57448e-d0cc-43bd-bd97-b0a6863671eb tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:04:19 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-7e57448e-d0cc-43bd-bd97-b0a6863671eb tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e45c15a3f348ec9862056beb628049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b090dd726e44a978a41caedb16a9737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 01:04:19 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-7e57448e-d0cc-43bd-bd97-b0a6863671eb tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c797729d-b48e-4614-a47c-47ad714e78f1" status: 200 len: 1546 microversion: 2.1 time: 0.160465 Apr 12 01:04:19 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 362/1082] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:04:19 2023] GET /compute/v2.1/servers/c797729d-b48e-4614-a47c-47ad714e78f1 => generated 1546 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 01:04:20 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-8151154d-4b97-4be4-a5d5-03e46cd88b41 req-3c28ae1a-c915-4461-a6a9-f37e331288ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c797729d-b48e-4614-a47c-47ad714e78f1", "name": "network-vif-unplugged", "status": "completed", "tag": "dd8d7486-ceab-40ab-968e-58a3bfeafb25"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:04:20 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8151154d-4b97-4be4-a5d5-03e46cd88b41 req-3c28ae1a-c915-4461-a6a9-f37e331288ab service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:04:20 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8151154d-4b97-4be4-a5d5-03e46cd88b41 req-3c28ae1a-c915-4461-a6a9-f37e331288ab service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:04:20 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8151154d-4b97-4be4-a5d5-03e46cd88b41 req-3c28ae1a-c915-4461-a6a9-f37e331288ab service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:04:21 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-8151154d-4b97-4be4-a5d5-03e46cd88b41 req-3c28ae1a-c915-4461-a6a9-f37e331288ab service nova] Creating event network-vif-unplugged:dd8d7486-ceab-40ab-968e-58a3bfeafb25 for instance c797729d-b48e-4614-a47c-47ad714e78f1 on user Apr 12 01:04:21 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-8151154d-4b97-4be4-a5d5-03e46cd88b41 req-3c28ae1a-c915-4461-a6a9-f37e331288ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030054 Apr 12 01:04:21 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 359/1083] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:04:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:04:22 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-b914d81b-0900-4a40-9fee-ce2c9101559e req-3d090d79-b0b5-4cd0-9649-2a9e0ffb250c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c797729d-b48e-4614-a47c-47ad714e78f1", "name": "network-vif-deleted", "tag": "dd8d7486-ceab-40ab-968e-58a3bfeafb25"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:04:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-b914d81b-0900-4a40-9fee-ce2c9101559e req-3d090d79-b0b5-4cd0-9649-2a9e0ffb250c service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:04:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-b914d81b-0900-4a40-9fee-ce2c9101559e req-3d090d79-b0b5-4cd0-9649-2a9e0ffb250c service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:04:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-b914d81b-0900-4a40-9fee-ce2c9101559e req-3d090d79-b0b5-4cd0-9649-2a9e0ffb250c service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:04:22 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-b914d81b-0900-4a40-9fee-ce2c9101559e req-3d090d79-b0b5-4cd0-9649-2a9e0ffb250c service nova] Creating event network-vif-deleted:dd8d7486-ceab-40ab-968e-58a3bfeafb25 for instance c797729d-b48e-4614-a47c-47ad714e78f1 on user Apr 12 01:04:22 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-b914d81b-0900-4a40-9fee-ce2c9101559e req-3d090d79-b0b5-4cd0-9649-2a9e0ffb250c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034537 Apr 12 01:04:22 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 363/1084] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:04:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:04:23 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-52ceccf6-98f9-4528-ae78-e608b5815389 req-26af669c-104e-4844-afa3-0a0d7f641e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c797729d-b48e-4614-a47c-47ad714e78f1", "name": "network-vif-plugged", "status": "completed", "tag": "dd8d7486-ceab-40ab-968e-58a3bfeafb25"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:04:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-52ceccf6-98f9-4528-ae78-e608b5815389 req-26af669c-104e-4844-afa3-0a0d7f641e2a service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:04:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-52ceccf6-98f9-4528-ae78-e608b5815389 req-26af669c-104e-4844-afa3-0a0d7f641e2a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:04:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-52ceccf6-98f9-4528-ae78-e608b5815389 req-26af669c-104e-4844-afa3-0a0d7f641e2a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:04:23 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-52ceccf6-98f9-4528-ae78-e608b5815389 req-26af669c-104e-4844-afa3-0a0d7f641e2a service nova] Creating event network-vif-plugged:dd8d7486-ceab-40ab-968e-58a3bfeafb25 for instance c797729d-b48e-4614-a47c-47ad714e78f1 on user Apr 12 01:04:23 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-52ceccf6-98f9-4528-ae78-e608b5815389 req-26af669c-104e-4844-afa3-0a0d7f641e2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056190 Apr 12 01:04:23 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 363/1085] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:04:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:04:49 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:04:49 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:04:49 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-133eea14-215e-45f8-8e78-b15fb53989ba tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:04:49 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-133eea14-215e-45f8-8e78-b15fb53989ba tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:04:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-133eea14-215e-45f8-8e78-b15fb53989ba tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:04:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-133eea14-215e-45f8-8e78-b15fb53989ba tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:04:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-133eea14-215e-45f8-8e78-b15fb53989ba tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:04:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-133eea14-215e-45f8-8e78-b15fb53989ba tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:04:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-133eea14-215e-45f8-8e78-b15fb53989ba tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:04:49 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-133eea14-215e-45f8-8e78-b15fb53989ba tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:04:49 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-133eea14-215e-45f8-8e78-b15fb53989ba tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.159728 Apr 12 01:04:49 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 360/1086] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 01:04:49 2023] GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/os-interface => generated 283 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:04:50 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:04:50 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:04:50 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=4 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:04:50 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=8 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:04:50 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-c2f3be5b-1963-41dc-ae1e-227e6717c72f tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:04:50 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-c2f3be5b-1963-41dc-ae1e-227e6717c72f tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:04:50 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-a72da537-d971-496c-92de-4fceea1e579d req-ac6cbb5b-5410-4ba4-ad43-f97731bd673d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d751ef5-bdbe-4b26-9499-5e17b63de0bb", "tag": "bcdd6d2c-9283-4da8-b5b7-7f4311803431"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:04:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c2f3be5b-1963-41dc-ae1e-227e6717c72f tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:04:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c2f3be5b-1963-41dc-ae1e-227e6717c72f tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:04:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c2f3be5b-1963-41dc-ae1e-227e6717c72f tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:04:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c2f3be5b-1963-41dc-ae1e-227e6717c72f tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:04:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c2f3be5b-1963-41dc-ae1e-227e6717c72f tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:04:50 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-c2f3be5b-1963-41dc-ae1e-227e6717c72f tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:04:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-a72da537-d971-496c-92de-4fceea1e579d req-ac6cbb5b-5410-4ba4-ad43-f97731bd673d service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:04:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-a72da537-d971-496c-92de-4fceea1e579d req-ac6cbb5b-5410-4ba4-ad43-f97731bd673d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:04:50 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-a72da537-d971-496c-92de-4fceea1e579d req-ac6cbb5b-5410-4ba4-ad43-f97731bd673d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:04:50 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-c2f3be5b-1963-41dc-ae1e-227e6717c72f tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/ips" status: 200 len: 104 microversion: 2.1 time: 0.044237 Apr 12 01:04:50 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 364/1087] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 01:04:50 2023] GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/ips => generated 104 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:04:50 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-a72da537-d971-496c-92de-4fceea1e579d req-ac6cbb5b-5410-4ba4-ad43-f97731bd673d service nova] Creating event network-changed:bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb on user Apr 12 01:04:50 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-a72da537-d971-496c-92de-4fceea1e579d req-ac6cbb5b-5410-4ba4-ad43-f97731bd673d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112053 Apr 12 01:04:50 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 364/1088] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:04:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:04:52 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c4c55f1-8a57-483a-a660-d4f65464d462"}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:04:52 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:04:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:04:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:04:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:04:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:04:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:04:52 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:04:52 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-df40fa51-9579-4481-9d5d-2c9334b5bc23 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281716 Apr 12 01:04:52 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 361/1089] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 01:04:52 2023] POST /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:04:59 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-e21dab07-f0c6-4339-bacf-09bcf7b6f4db tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:04:59 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e21dab07-f0c6-4339-bacf-09bcf7b6f4db tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:04:59 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e21dab07-f0c6-4339-bacf-09bcf7b6f4db tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:04:59 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-e21dab07-f0c6-4339-bacf-09bcf7b6f4db tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:04:59 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-e21dab07-f0c6-4339-bacf-09bcf7b6f4db tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Going to try to stop instance {{(pid=72494) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 12 01:04:59 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-e21dab07-f0c6-4339-bacf-09bcf7b6f4db tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/action" status: 202 len: 0 microversion: 2.1 time: 0.123774 Apr 12 01:04:59 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 365/1090] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 01:04:59 2023] POST /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 01:04:59 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-acf450cb-3883-4e21-b562-f5c73beb260a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:04:59 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-acf450cb-3883-4e21-b562-f5c73beb260a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:04:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-acf450cb-3883-4e21-b562-f5c73beb260a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:04:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-acf450cb-3883-4e21-b562-f5c73beb260a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:04:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-acf450cb-3883-4e21-b562-f5c73beb260a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:04:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-acf450cb-3883-4e21-b562-f5c73beb260a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:04:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-acf450cb-3883-4e21-b562-f5c73beb260a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:04:59 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-acf450cb-3883-4e21-b562-f5c73beb260a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:04:59 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-acf450cb-3883-4e21-b562-f5c73beb260a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8bacd3b6194651bc5820c3221ed45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9933281dea437cbaae1040fa06ff06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 01:04:59 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-acf450cb-3883-4e21-b562-f5c73beb260a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb" status: 200 len: 1711 microversion: 2.1 time: 0.200136 Apr 12 01:04:59 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 365/1091] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:04:59 2023] GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb => generated 1711 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 01:04:59 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-8a4ebae6-3d8e-45a7-841f-760e0a810518 req-f495d44f-425f-4022-bee1-035b60fa4904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d751ef5-bdbe-4b26-9499-5e17b63de0bb", "name": "network-vif-unplugged", "status": "completed", "tag": "bcdd6d2c-9283-4da8-b5b7-7f4311803431"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:04:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8a4ebae6-3d8e-45a7-841f-760e0a810518 req-f495d44f-425f-4022-bee1-035b60fa4904 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:04:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8a4ebae6-3d8e-45a7-841f-760e0a810518 req-f495d44f-425f-4022-bee1-035b60fa4904 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:04:59 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-8a4ebae6-3d8e-45a7-841f-760e0a810518 req-f495d44f-425f-4022-bee1-035b60fa4904 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:04:59 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-8a4ebae6-3d8e-45a7-841f-760e0a810518 req-f495d44f-425f-4022-bee1-035b60fa4904 service nova] Creating event network-vif-unplugged:bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb on user Apr 12 01:04:59 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-8a4ebae6-3d8e-45a7-841f-760e0a810518 req-f495d44f-425f-4022-bee1-035b60fa4904 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036542 Apr 12 01:04:59 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 362/1092] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:04:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:05:01 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-4275febf-ca1c-4bcf-80de-7693feb8c6bc req-38ae9174-34d2-4696-9f82-885a3b8bc391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d751ef5-bdbe-4b26-9499-5e17b63de0bb", "name": "network-vif-plugged", "status": "completed", "tag": "bcdd6d2c-9283-4da8-b5b7-7f4311803431"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:05:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-4275febf-ca1c-4bcf-80de-7693feb8c6bc req-38ae9174-34d2-4696-9f82-885a3b8bc391 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:05:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-4275febf-ca1c-4bcf-80de-7693feb8c6bc req-38ae9174-34d2-4696-9f82-885a3b8bc391 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:05:01 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-4275febf-ca1c-4bcf-80de-7693feb8c6bc req-38ae9174-34d2-4696-9f82-885a3b8bc391 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:05:01 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-4275febf-ca1c-4bcf-80de-7693feb8c6bc req-38ae9174-34d2-4696-9f82-885a3b8bc391 service nova] Creating event network-vif-plugged:bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb on user Apr 12 01:05:01 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-4275febf-ca1c-4bcf-80de-7693feb8c6bc req-38ae9174-34d2-4696-9f82-885a3b8bc391 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029748 Apr 12 01:05:01 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 366/1093] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:05:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:05:09 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-29ea978f-4f97-4ea9-9069-ae1e12e691f9 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:05:09 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-29ea978f-4f97-4ea9-9069-ae1e12e691f9 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: c797729d-b48e-4614-a47c-47ad714e78f1] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:05:09 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:05:09 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=8 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:05:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-29ea978f-4f97-4ea9-9069-ae1e12e691f9 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:05:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-29ea978f-4f97-4ea9-9069-ae1e12e691f9 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:05:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-29ea978f-4f97-4ea9-9069-ae1e12e691f9 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:05:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-29ea978f-4f97-4ea9-9069-ae1e12e691f9 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:05:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-29ea978f-4f97-4ea9-9069-ae1e12e691f9 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:05:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-29ea978f-4f97-4ea9-9069-ae1e12e691f9 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:05:09 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-29ea978f-4f97-4ea9-9069-ae1e12e691f9 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] HTTP exception thrown: Instance c797729d-b48e-4614-a47c-47ad714e78f1 could not be found. Apr 12 01:05:09 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-29ea978f-4f97-4ea9-9069-ae1e12e691f9 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Request method failure captured: Apr 12 01:05:09 user devstack@n-api.service[72496]: request: GET /compute/v2.1/servers/c797729d-b48e-4614-a47c-47ad714e78f1 HTTP/1.1 Apr 12 01:05:09 user devstack@n-api.service[72496]: Accept: application/json Apr 12 01:05:09 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 01:05:09 user devstack@n-api.service[72496]: Connection: close Apr 12 01:05:09 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 01:05:09 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 01:05:09 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 01:05:09 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 01:05:09 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 01:05:09 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNgMSx2w6v3B2KAlAZgdc84iBK2fHST4bhm3v6lHUagYzGVKK9a_TcV3xGsyfWR_tQqQCFpsYxxGLRFZulKt_k79XEtCQ-T45_S8aN5gwCfRjAQ71F1lIJiIqFypENEvV0306c7FSm_7uIEoYZvK3VTNw6CEJLODNuaxGPIFeWq5P9i0 Apr 12 01:05:09 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 01:05:09 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 01:05:09 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 01:05:09 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 01:05:09 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 01:05:09 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 01:05:09 user devstack@n-api.service[72496]: X-Project-Id: 8b090dd726e44a978a41caedb16a9737 Apr 12 01:05:09 user devstack@n-api.service[72496]: X-Project-Name: tempest-VolumesSnapshotTestJSON-490135070 Apr 12 01:05:09 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 01:05:09 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 01:05:09 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8b090dd726e44a978a41caedb16a9737"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8b090dd726e44a978a41caedb16a9737"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8b090dd726e44a978a41caedb16a9737"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 01:05:09 user devstack@n-api.service[72496]: X-Tenant: tempest-VolumesSnapshotTestJSON-490135070 Apr 12 01:05:09 user devstack@n-api.service[72496]: X-Tenant-Id: 8b090dd726e44a978a41caedb16a9737 Apr 12 01:05:09 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-490135070 Apr 12 01:05:09 user devstack@n-api.service[72496]: X-User: tempest-VolumesSnapshotTestJSON-490135070-project-member Apr 12 01:05:09 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 01:05:09 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 01:05:09 user devstack@n-api.service[72496]: X-User-Id: 37e45c15a3f348ec9862056beb628049 Apr 12 01:05:09 user devstack@n-api.service[72496]: X-User-Name: tempest-VolumesSnapshotTestJSON-490135070-project-member Apr 12 01:05:09 user devstack@n-api.service[72496]: method: > Apr 12 01:05:09 user devstack@n-api.service[72496]: exception: Instance c797729d-b48e-4614-a47c-47ad714e78f1 could not be found. Apr 12 01:05:09 user devstack@n-api.service[72496]: action_args: {'id': 'c797729d-b48e-4614-a47c-47ad714e78f1'} Apr 12 01:05:09 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c797729d-b48e-4614-a47c-47ad714e78f1 could not be found. Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c797729d-b48e-4614-a47c-47ad714e78f1 could not be found. Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c797729d-b48e-4614-a47c-47ad714e78f1 could not be found. Apr 12 01:05:09 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 01:05:09 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-29ea978f-4f97-4ea9-9069-ae1e12e691f9 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Returning 404 to user: Instance c797729d-b48e-4614-a47c-47ad714e78f1 could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 01:05:09 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-29ea978f-4f97-4ea9-9069-ae1e12e691f9 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c797729d-b48e-4614-a47c-47ad714e78f1" status: 404 len: 111 microversion: 2.1 time: 0.040468 Apr 12 01:05:09 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 366/1094] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:05:09 2023] GET /compute/v2.1/servers/c797729d-b48e-4614-a47c-47ad714e78f1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 01:05:14 user devstack@n-api.service[72495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 12 01:05:14 user devstack@n-api.service[72495]: Wed Apr 12 01:05:14 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 12 01:05:14 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:05:14 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:05:14 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-685862765", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "networks": [{"uuid": "d7d7d428-1112-4a7b-bddd-0b8ff59971d8"}]}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:05:14 user devstack@n-api.service[72495]: DEBUG nova.network.neutron [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] validate_networks() for [('d7d7d428-1112-4a7b-bddd-0b8ff59971d8', None, None, None, None, None)] {{(pid=72495) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 01:05:15 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Flavor limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 01:05:15 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Image limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 01:05:15 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Flavor pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 01:05:15 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Image pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 01:05:15 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 01:05:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:05:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:05:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:05:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:05:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:05:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:05:15 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Getting quotas for project 8b090dd726e44a978a41caedb16a9737. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 01:05:15 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Getting quotas for user 37e45c15a3f348ec9862056beb628049 and project 8b090dd726e44a978a41caedb16a9737. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 01:05:15 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Going to run 1 instances... {{(pid=72495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 01:05:15 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 01:05:15 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-4750281e-ebce-4b60-a90a-8868717ab7b5 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.539158 Apr 12 01:05:15 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 363/1095] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 01:05:14 2023] POST /compute/v2.1/servers => generated 378 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 01:05:15 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=6 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:05:15 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:05:15 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-6ee6edaa-87d2-41ec-8fe2-6e9b0e77482a tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:05:15 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-6ee6edaa-87d2-41ec-8fe2-6e9b0e77482a tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:05:15 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-6ee6edaa-87d2-41ec-8fe2-6e9b0e77482a tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e45c15a3f348ec9862056beb628049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b090dd726e44a978a41caedb16a9737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 01:05:15 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-6ee6edaa-87d2-41ec-8fe2-6e9b0e77482a tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5a16f3f-6322-4212-8f32-dec6eb161780" status: 200 len: 1212 microversion: 2.1 time: 0.071132 Apr 12 01:05:15 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 367/1096] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:05:15 2023] GET /compute/v2.1/servers/d5a16f3f-6322-4212-8f32-dec6eb161780 => generated 1212 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 01:05:17 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-4deea7bd-2ce0-461a-aee3-898cf4c4e1e1 req-9974376e-703f-4938-a883-78845c788ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5a16f3f-6322-4212-8f32-dec6eb161780", "tag": "5712cd10-28ae-41a2-bb88-dc250f896d37"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:05:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4deea7bd-2ce0-461a-aee3-898cf4c4e1e1 req-9974376e-703f-4938-a883-78845c788ea2 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:05:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4deea7bd-2ce0-461a-aee3-898cf4c4e1e1 req-9974376e-703f-4938-a883-78845c788ea2 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:05:17 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4deea7bd-2ce0-461a-aee3-898cf4c4e1e1 req-9974376e-703f-4938-a883-78845c788ea2 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:05:17 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-4deea7bd-2ce0-461a-aee3-898cf4c4e1e1 req-9974376e-703f-4938-a883-78845c788ea2 service nova] Creating event network-changed:5712cd10-28ae-41a2-bb88-dc250f896d37 for instance d5a16f3f-6322-4212-8f32-dec6eb161780 on user Apr 12 01:05:17 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-4deea7bd-2ce0-461a-aee3-898cf4c4e1e1 req-9974376e-703f-4938-a883-78845c788ea2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031327 Apr 12 01:05:17 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 367/1097] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:05:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:05:19 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-082a6815-7d49-4153-843b-65d616ac5469 req-0ef2a29b-a55d-4363-81ec-20f5323f0b85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5a16f3f-6322-4212-8f32-dec6eb161780", "name": "network-vif-plugged", "status": "completed", "tag": "5712cd10-28ae-41a2-bb88-dc250f896d37"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:05:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-082a6815-7d49-4153-843b-65d616ac5469 req-0ef2a29b-a55d-4363-81ec-20f5323f0b85 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:05:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-082a6815-7d49-4153-843b-65d616ac5469 req-0ef2a29b-a55d-4363-81ec-20f5323f0b85 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:05:19 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-082a6815-7d49-4153-843b-65d616ac5469 req-0ef2a29b-a55d-4363-81ec-20f5323f0b85 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:05:19 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-082a6815-7d49-4153-843b-65d616ac5469 req-0ef2a29b-a55d-4363-81ec-20f5323f0b85 service nova] Creating event network-vif-plugged:5712cd10-28ae-41a2-bb88-dc250f896d37 for instance d5a16f3f-6322-4212-8f32-dec6eb161780 on user Apr 12 01:05:19 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-082a6815-7d49-4153-843b-65d616ac5469 req-0ef2a29b-a55d-4363-81ec-20f5323f0b85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028980 Apr 12 01:05:19 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 364/1098] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:05:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:05:21 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-fa07b131-6f39-4a92-94af-a38e09e1418d req-1a6207f1-a1b1-449f-a1cb-edcdb1242f34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5a16f3f-6322-4212-8f32-dec6eb161780", "name": "network-vif-plugged", "status": "completed", "tag": "5712cd10-28ae-41a2-bb88-dc250f896d37"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:05:21 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-fa07b131-6f39-4a92-94af-a38e09e1418d req-1a6207f1-a1b1-449f-a1cb-edcdb1242f34 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:05:21 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-fa07b131-6f39-4a92-94af-a38e09e1418d req-1a6207f1-a1b1-449f-a1cb-edcdb1242f34 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:05:21 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-fa07b131-6f39-4a92-94af-a38e09e1418d req-1a6207f1-a1b1-449f-a1cb-edcdb1242f34 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:05:21 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-fa07b131-6f39-4a92-94af-a38e09e1418d req-1a6207f1-a1b1-449f-a1cb-edcdb1242f34 service nova] Creating event network-vif-plugged:5712cd10-28ae-41a2-bb88-dc250f896d37 for instance d5a16f3f-6322-4212-8f32-dec6eb161780 on user Apr 12 01:05:21 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-fa07b131-6f39-4a92-94af-a38e09e1418d req-1a6207f1-a1b1-449f-a1cb-edcdb1242f34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030130 Apr 12 01:05:21 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 368/1099] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:05:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:05:49 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:05:49 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:05:49 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-98b72abf-5ef5-4464-9d36-244249aa7feb tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:05:49 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-98b72abf-5ef5-4464-9d36-244249aa7feb tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:05:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-98b72abf-5ef5-4464-9d36-244249aa7feb tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:05:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-98b72abf-5ef5-4464-9d36-244249aa7feb tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:05:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-98b72abf-5ef5-4464-9d36-244249aa7feb tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:05:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-98b72abf-5ef5-4464-9d36-244249aa7feb tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:05:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-98b72abf-5ef5-4464-9d36-244249aa7feb tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:05:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-98b72abf-5ef5-4464-9d36-244249aa7feb tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:05:49 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-98b72abf-5ef5-4464-9d36-244249aa7feb tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8bacd3b6194651bc5820c3221ed45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9933281dea437cbaae1040fa06ff06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 01:05:49 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-98b72abf-5ef5-4464-9d36-244249aa7feb tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb" status: 200 len: 1688 microversion: 2.1 time: 0.167122 Apr 12 01:05:49 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 368/1100] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:05:49 2023] GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 01:06:05 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:06:05 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:06:05 user devstack@n-api.service[72495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 01:06:05 user devstack@n-api.service[72495]: Wed Apr 12 01:06:05 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d5a16f3f-6322-4212-8f32-dec6eb161780 (ip 10.0.0.210) !!! Apr 12 01:06:05 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:06:05 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:06:05 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-2b5c530c-5fd3-4a68-8d5c-769172516cfc tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:06:05 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-2b5c530c-5fd3-4a68-8d5c-769172516cfc tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:06:05 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2b5c530c-5fd3-4a68-8d5c-769172516cfc tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:06:05 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2b5c530c-5fd3-4a68-8d5c-769172516cfc tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:06:05 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2b5c530c-5fd3-4a68-8d5c-769172516cfc tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:06:05 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2b5c530c-5fd3-4a68-8d5c-769172516cfc tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:06:05 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2b5c530c-5fd3-4a68-8d5c-769172516cfc tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:06:05 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2b5c530c-5fd3-4a68-8d5c-769172516cfc tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:06:05 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-2b5c530c-5fd3-4a68-8d5c-769172516cfc tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e45c15a3f348ec9862056beb628049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b090dd726e44a978a41caedb16a9737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 01:06:05 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-2b5c530c-5fd3-4a68-8d5c-769172516cfc tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5a16f3f-6322-4212-8f32-dec6eb161780" status: 200 len: 1495 microversion: 2.1 time: 0.159217 Apr 12 01:06:05 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 365/1101] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:06:05 2023] GET /compute/v2.1/servers/d5a16f3f-6322-4212-8f32-dec6eb161780 => generated 1495 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 01:06:49 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:06:49 user devstack@n-api.service[72494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 01:06:49 user devstack@n-api.service[72494]: Wed Apr 12 01:06:49 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/action (ip 10.0.0.210) !!! Apr 12 01:06:49 user devstack@n-api.service[72494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 01:06:49 user devstack@n-api.service[72494]: Wed Apr 12 01:06:49 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/action (ip 10.0.0.210) !!! Apr 12 01:06:49 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=6 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:06:49 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:06:49 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:06:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:06:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:06:49 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:06:49 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Going to try to start instance {{(pid=72494) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 12 01:06:49 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-259b6e36-369d-42d6-af45-d5d5c6f3458c tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/action" status: 202 len: 0 microversion: 2.1 time: 0.100952 Apr 12 01:06:49 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 369/1102] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 01:06:49 2023] POST /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 01:06:49 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:06:49 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:06:49 user devstack@n-api.service[72496]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 01:06:49 user devstack@n-api.service[72496]: Wed Apr 12 01:06:49 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb (ip 10.0.0.210) !!! Apr 12 01:06:49 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-3e87341b-59a7-4841-bb25-7d96a0a1df82 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:06:49 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-3e87341b-59a7-4841-bb25-7d96a0a1df82 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:06:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-3e87341b-59a7-4841-bb25-7d96a0a1df82 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:06:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-3e87341b-59a7-4841-bb25-7d96a0a1df82 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:06:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-3e87341b-59a7-4841-bb25-7d96a0a1df82 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:06:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-3e87341b-59a7-4841-bb25-7d96a0a1df82 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:06:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-3e87341b-59a7-4841-bb25-7d96a0a1df82 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:06:49 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-3e87341b-59a7-4841-bb25-7d96a0a1df82 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:06:50 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-3e87341b-59a7-4841-bb25-7d96a0a1df82 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8bacd3b6194651bc5820c3221ed45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9933281dea437cbaae1040fa06ff06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 01:06:50 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-3e87341b-59a7-4841-bb25-7d96a0a1df82 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb" status: 200 len: 1697 microversion: 2.1 time: 0.267356 Apr 12 01:06:50 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 369/1103] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:06:49 2023] GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb => generated 1697 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 01:06:54 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-f50df841-bb86-405d-bf2e-3f04ca9cb863 req-cf439118-a506-4d43-96b0-fbcae41d0218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d751ef5-bdbe-4b26-9499-5e17b63de0bb", "name": "network-vif-plugged", "status": "completed", "tag": "bcdd6d2c-9283-4da8-b5b7-7f4311803431"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:06:54 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:06:54 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:06:54 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-f50df841-bb86-405d-bf2e-3f04ca9cb863 req-cf439118-a506-4d43-96b0-fbcae41d0218 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:06:54 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-f50df841-bb86-405d-bf2e-3f04ca9cb863 req-cf439118-a506-4d43-96b0-fbcae41d0218 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:06:54 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-f50df841-bb86-405d-bf2e-3f04ca9cb863 req-cf439118-a506-4d43-96b0-fbcae41d0218 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:06:54 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-f50df841-bb86-405d-bf2e-3f04ca9cb863 req-cf439118-a506-4d43-96b0-fbcae41d0218 service nova] Creating event network-vif-plugged:bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb on user Apr 12 01:06:54 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-f50df841-bb86-405d-bf2e-3f04ca9cb863 req-cf439118-a506-4d43-96b0-fbcae41d0218 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041748 Apr 12 01:06:54 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 366/1104] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:06:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:06:56 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-2978b9d9-37f2-4281-ac81-239c7b7c6956 req-9b4cbfd0-aa5f-4287-993a-3089d42a57dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d751ef5-bdbe-4b26-9499-5e17b63de0bb", "name": "network-vif-plugged", "status": "completed", "tag": "bcdd6d2c-9283-4da8-b5b7-7f4311803431"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:06:56 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-2978b9d9-37f2-4281-ac81-239c7b7c6956 req-9b4cbfd0-aa5f-4287-993a-3089d42a57dd service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:06:56 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-2978b9d9-37f2-4281-ac81-239c7b7c6956 req-9b4cbfd0-aa5f-4287-993a-3089d42a57dd service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:06:56 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-2978b9d9-37f2-4281-ac81-239c7b7c6956 req-9b4cbfd0-aa5f-4287-993a-3089d42a57dd service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:06:56 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-2978b9d9-37f2-4281-ac81-239c7b7c6956 req-9b4cbfd0-aa5f-4287-993a-3089d42a57dd service nova] Creating event network-vif-plugged:bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb on user Apr 12 01:06:56 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-2978b9d9-37f2-4281-ac81-239c7b7c6956 req-9b4cbfd0-aa5f-4287-993a-3089d42a57dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089143 Apr 12 01:06:56 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 370/1105] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:06:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:07:05 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e18973ee-543f-44f4-8032-3153cf1b7d43", "device": "/dev/vdb"}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:07:05 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:07:05 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:07:05 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:07:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:07:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:07:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:07:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:07:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:07:05 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:07:05 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-2065298b-4d40-485c-ba3f-24e0a3fd5f92 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d5a16f3f-6322-4212-8f32-dec6eb161780/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.338014 Apr 12 01:07:05 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 370/1106] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 01:07:05 2023] POST /compute/v2.1/servers/d5a16f3f-6322-4212-8f32-dec6eb161780/os-volume_attachments => generated 194 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:07:18 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:07:18 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:07:18 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:07:18 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:07:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:07:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:07:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:07:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:07:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:07:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:07:18 user devstack@n-api.service[72495]: DEBUG nova.objects.instance [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lazy-loading 'services' on Instance uuid d5a16f3f-6322-4212-8f32-dec6eb161780 {{(pid=72495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 01:07:18 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-7974aa10-762d-4db7-a4da-cd0cb477db5f tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d5a16f3f-6322-4212-8f32-dec6eb161780/os-volume_attachments/e18973ee-543f-44f4-8032-3153cf1b7d43" status: 202 len: 0 microversion: 2.1 time: 0.251752 Apr 12 01:07:18 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 367/1107] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 01:07:18 2023] DELETE /compute/v2.1/servers/d5a16f3f-6322-4212-8f32-dec6eb161780/os-volume_attachments/e18973ee-543f-44f4-8032-3153cf1b7d43 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 01:07:18 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=4 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:07:18 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:07:18 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:07:18 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:07:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:07:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:07:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:07:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:07:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:07:18 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:07:18 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Going to try to terminate instance {{(pid=72494) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 01:07:18 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-84738462-1ffa-476f-b7e9-d6503effd560 tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d5a16f3f-6322-4212-8f32-dec6eb161780" status: 204 len: 0 microversion: 2.1 time: 0.128663 Apr 12 01:07:18 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 371/1108] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 01:07:18 2023] DELETE /compute/v2.1/servers/d5a16f3f-6322-4212-8f32-dec6eb161780 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 01:07:18 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:07:18 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:07:18 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-78ad5b69-5724-4386-93be-26adfc1ff3ad tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:07:18 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-78ad5b69-5724-4386-93be-26adfc1ff3ad tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:07:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-78ad5b69-5724-4386-93be-26adfc1ff3ad tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:07:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-78ad5b69-5724-4386-93be-26adfc1ff3ad tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:07:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-78ad5b69-5724-4386-93be-26adfc1ff3ad tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:07:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-78ad5b69-5724-4386-93be-26adfc1ff3ad tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:07:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-78ad5b69-5724-4386-93be-26adfc1ff3ad tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:07:18 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-78ad5b69-5724-4386-93be-26adfc1ff3ad tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:07:18 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-78ad5b69-5724-4386-93be-26adfc1ff3ad tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37e45c15a3f348ec9862056beb628049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b090dd726e44a978a41caedb16a9737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 01:07:18 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-78ad5b69-5724-4386-93be-26adfc1ff3ad tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5a16f3f-6322-4212-8f32-dec6eb161780" status: 200 len: 1547 microversion: 2.1 time: 0.169554 Apr 12 01:07:18 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 371/1109] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:07:18 2023] GET /compute/v2.1/servers/d5a16f3f-6322-4212-8f32-dec6eb161780 => generated 1547 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 01:07:20 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-4d786a75-a85a-48cc-a271-faf52146cd4e req-5f987ce6-282b-4f39-9c4d-d6fe5c6baada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5a16f3f-6322-4212-8f32-dec6eb161780", "name": "network-vif-unplugged", "status": "completed", "tag": "5712cd10-28ae-41a2-bb88-dc250f896d37"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:07:20 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-4d786a75-a85a-48cc-a271-faf52146cd4e req-5f987ce6-282b-4f39-9c4d-d6fe5c6baada service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:07:20 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-4d786a75-a85a-48cc-a271-faf52146cd4e req-5f987ce6-282b-4f39-9c4d-d6fe5c6baada service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:07:20 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-4d786a75-a85a-48cc-a271-faf52146cd4e req-5f987ce6-282b-4f39-9c4d-d6fe5c6baada service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:07:20 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-4d786a75-a85a-48cc-a271-faf52146cd4e req-5f987ce6-282b-4f39-9c4d-d6fe5c6baada service nova] Creating event network-vif-unplugged:5712cd10-28ae-41a2-bb88-dc250f896d37 for instance d5a16f3f-6322-4212-8f32-dec6eb161780 on user Apr 12 01:07:20 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-4d786a75-a85a-48cc-a271-faf52146cd4e req-5f987ce6-282b-4f39-9c4d-d6fe5c6baada service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034814 Apr 12 01:07:20 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 368/1110] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:07:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:07:21 user devstack@n-api.service[72494]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3a1bc446-f0cd-4585-b07d-b5da09904692] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 12 01:07:21 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-992cd2b8-6542-4956-8bab-0a0ea600301c req-c1bdfdbc-bad5-463a-8fc9-1fdebd667d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5a16f3f-6322-4212-8f32-dec6eb161780", "name": "network-vif-deleted", "tag": "5712cd10-28ae-41a2-bb88-dc250f896d37"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:07:21 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-992cd2b8-6542-4956-8bab-0a0ea600301c req-c1bdfdbc-bad5-463a-8fc9-1fdebd667d8c service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:07:21 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-992cd2b8-6542-4956-8bab-0a0ea600301c req-c1bdfdbc-bad5-463a-8fc9-1fdebd667d8c service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:07:21 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-992cd2b8-6542-4956-8bab-0a0ea600301c req-c1bdfdbc-bad5-463a-8fc9-1fdebd667d8c service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:07:21 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-992cd2b8-6542-4956-8bab-0a0ea600301c req-c1bdfdbc-bad5-463a-8fc9-1fdebd667d8c service nova] Creating event network-vif-deleted:5712cd10-28ae-41a2-bb88-dc250f896d37 for instance d5a16f3f-6322-4212-8f32-dec6eb161780 on user Apr 12 01:07:21 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-992cd2b8-6542-4956-8bab-0a0ea600301c req-c1bdfdbc-bad5-463a-8fc9-1fdebd667d8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082863 Apr 12 01:07:21 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 372/1111] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:07:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:07:22 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-0bde4109-2a46-4ad6-b960-68df9334ccae req-3239fac3-70fa-4a2b-b634-9d92e9da72ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5a16f3f-6322-4212-8f32-dec6eb161780", "name": "network-vif-plugged", "status": "completed", "tag": "5712cd10-28ae-41a2-bb88-dc250f896d37"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:07:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-0bde4109-2a46-4ad6-b960-68df9334ccae req-3239fac3-70fa-4a2b-b634-9d92e9da72ec service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:07:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-0bde4109-2a46-4ad6-b960-68df9334ccae req-3239fac3-70fa-4a2b-b634-9d92e9da72ec service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:07:22 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-0bde4109-2a46-4ad6-b960-68df9334ccae req-3239fac3-70fa-4a2b-b634-9d92e9da72ec service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:07:22 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-0bde4109-2a46-4ad6-b960-68df9334ccae req-3239fac3-70fa-4a2b-b634-9d92e9da72ec service nova] Creating event network-vif-plugged:5712cd10-28ae-41a2-bb88-dc250f896d37 for instance d5a16f3f-6322-4212-8f32-dec6eb161780 on user Apr 12 01:07:22 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-0bde4109-2a46-4ad6-b960-68df9334ccae req-3239fac3-70fa-4a2b-b634-9d92e9da72ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033569 Apr 12 01:07:22 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 372/1112] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:07:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:07:40 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:07:40 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:07:40 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-99b1e5f2-f6f2-47e3-984a-e4316e6c024a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:07:40 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-99b1e5f2-f6f2-47e3-984a-e4316e6c024a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:07:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-99b1e5f2-f6f2-47e3-984a-e4316e6c024a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:07:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-99b1e5f2-f6f2-47e3-984a-e4316e6c024a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:07:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-99b1e5f2-f6f2-47e3-984a-e4316e6c024a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:07:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-99b1e5f2-f6f2-47e3-984a-e4316e6c024a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:07:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-99b1e5f2-f6f2-47e3-984a-e4316e6c024a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:07:40 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-99b1e5f2-f6f2-47e3-984a-e4316e6c024a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:07:40 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-99b1e5f2-f6f2-47e3-984a-e4316e6c024a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8bacd3b6194651bc5820c3221ed45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9933281dea437cbaae1040fa06ff06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 01:07:40 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-99b1e5f2-f6f2-47e3-984a-e4316e6c024a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb" status: 200 len: 1701 microversion: 2.1 time: 0.157629 Apr 12 01:07:40 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 369/1113] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:07:40 2023] GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb => generated 1701 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 01:08:09 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:08:09 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:08:09 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-1b381af6-4838-4aed-b98e-0609ef4ae76d tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:08:09 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-1b381af6-4838-4aed-b98e-0609ef4ae76d tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] [instance: d5a16f3f-6322-4212-8f32-dec6eb161780] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:08:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1b381af6-4838-4aed-b98e-0609ef4ae76d tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:08:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1b381af6-4838-4aed-b98e-0609ef4ae76d tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:08:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1b381af6-4838-4aed-b98e-0609ef4ae76d tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:08:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1b381af6-4838-4aed-b98e-0609ef4ae76d tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:08:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1b381af6-4838-4aed-b98e-0609ef4ae76d tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:08:09 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1b381af6-4838-4aed-b98e-0609ef4ae76d tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:08:09 user devstack@n-api.service[72494]: INFO oslo.messaging._drivers.impl_rabbit [-] [3a1bc446-f0cd-4585-b07d-b5da09904692] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 49964. Apr 12 01:08:09 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-1b381af6-4838-4aed-b98e-0609ef4ae76d tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] HTTP exception thrown: Instance d5a16f3f-6322-4212-8f32-dec6eb161780 could not be found. Apr 12 01:08:09 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-1b381af6-4838-4aed-b98e-0609ef4ae76d tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Request method failure captured: Apr 12 01:08:09 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/d5a16f3f-6322-4212-8f32-dec6eb161780 HTTP/1.1 Apr 12 01:08:09 user devstack@n-api.service[72494]: Accept: application/json Apr 12 01:08:09 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 01:08:09 user devstack@n-api.service[72494]: Connection: close Apr 12 01:08:09 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 01:08:09 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 01:08:09 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 01:08:09 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 01:08:09 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 01:08:09 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNgMSx2w6v3B2KAlAZgdc84iBK2fHST4bhm3v6lHUagYzGVKK9a_TcV3xGsyfWR_tQqQCFpsYxxGLRFZulKt_k79XEtCQ-T45_S8aN5gwCfRjAQ71F1lIJiIqFypENEvV0306c7FSm_7uIEoYZvK3VTNw6CEJLODNuaxGPIFeWq5P9i0 Apr 12 01:08:09 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 01:08:09 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 01:08:09 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 01:08:09 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 01:08:09 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 01:08:09 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 01:08:09 user devstack@n-api.service[72494]: X-Project-Id: 8b090dd726e44a978a41caedb16a9737 Apr 12 01:08:09 user devstack@n-api.service[72494]: X-Project-Name: tempest-VolumesSnapshotTestJSON-490135070 Apr 12 01:08:09 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 01:08:09 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 01:08:09 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8b090dd726e44a978a41caedb16a9737"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8b090dd726e44a978a41caedb16a9737"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8b090dd726e44a978a41caedb16a9737"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 01:08:09 user devstack@n-api.service[72494]: X-Tenant: tempest-VolumesSnapshotTestJSON-490135070 Apr 12 01:08:09 user devstack@n-api.service[72494]: X-Tenant-Id: 8b090dd726e44a978a41caedb16a9737 Apr 12 01:08:09 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-490135070 Apr 12 01:08:09 user devstack@n-api.service[72494]: X-User: tempest-VolumesSnapshotTestJSON-490135070-project-member Apr 12 01:08:09 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 01:08:09 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 01:08:09 user devstack@n-api.service[72494]: X-User-Id: 37e45c15a3f348ec9862056beb628049 Apr 12 01:08:09 user devstack@n-api.service[72494]: X-User-Name: tempest-VolumesSnapshotTestJSON-490135070-project-member Apr 12 01:08:09 user devstack@n-api.service[72494]: method: > Apr 12 01:08:09 user devstack@n-api.service[72494]: exception: Instance d5a16f3f-6322-4212-8f32-dec6eb161780 could not be found. Apr 12 01:08:09 user devstack@n-api.service[72494]: action_args: {'id': 'd5a16f3f-6322-4212-8f32-dec6eb161780'} Apr 12 01:08:09 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5a16f3f-6322-4212-8f32-dec6eb161780 could not be found. Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5a16f3f-6322-4212-8f32-dec6eb161780 could not be found. Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5a16f3f-6322-4212-8f32-dec6eb161780 could not be found. Apr 12 01:08:09 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:08:09 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-1b381af6-4838-4aed-b98e-0609ef4ae76d tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] Returning 404 to user: Instance d5a16f3f-6322-4212-8f32-dec6eb161780 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 01:08:09 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-1b381af6-4838-4aed-b98e-0609ef4ae76d tempest-VolumesSnapshotTestJSON-490135070 tempest-VolumesSnapshotTestJSON-490135070-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5a16f3f-6322-4212-8f32-dec6eb161780" status: 404 len: 111 microversion: 2.1 time: 0.041016 Apr 12 01:08:09 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 373/1114] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:08:09 2023] GET /compute/v2.1/servers/d5a16f3f-6322-4212-8f32-dec6eb161780 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 01:08:40 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:08:40 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=8 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:08:40 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:08:40 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:08:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:08:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:08:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:08:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:08:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:08:40 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:08:40 user devstack@n-api.service[72496]: DEBUG nova.objects.instance [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'services' on Instance uuid 9d751ef5-bdbe-4b26-9499-5e17b63de0bb {{(pid=72496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 01:08:40 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-06719fc2-8fad-48e3-82d2-e2b95f5d0dd9 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/os-volume_attachments/8c4c55f1-8a57-483a-a660-d4f65464d462" status: 202 len: 0 microversion: 2.1 time: 0.386384 Apr 12 01:08:40 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 373/1115] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 01:08:40 2023] DELETE /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/os-volume_attachments/8c4c55f1-8a57-483a-a660-d4f65464d462 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 01:08:43 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:08:43 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:08:43 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-55327532-3a08-40f6-bc88-df8be58ae3a4 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:08:43 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-55327532-3a08-40f6-bc88-df8be58ae3a4 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:08:43 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-55327532-3a08-40f6-bc88-df8be58ae3a4 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:08:43 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-55327532-3a08-40f6-bc88-df8be58ae3a4 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:08:43 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-55327532-3a08-40f6-bc88-df8be58ae3a4 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Going to try to stop instance {{(pid=72495) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 12 01:08:43 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-55327532-3a08-40f6-bc88-df8be58ae3a4 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/action" status: 202 len: 0 microversion: 2.1 time: 0.119874 Apr 12 01:08:43 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 370/1116] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 01:08:43 2023] POST /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 01:08:43 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-7ea851c2-b5d9-4a8d-aaa3-c110e1c6085d tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:08:43 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-7ea851c2-b5d9-4a8d-aaa3-c110e1c6085d tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:08:43 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:08:43 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:08:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7ea851c2-b5d9-4a8d-aaa3-c110e1c6085d tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:08:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7ea851c2-b5d9-4a8d-aaa3-c110e1c6085d tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:08:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7ea851c2-b5d9-4a8d-aaa3-c110e1c6085d tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:08:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7ea851c2-b5d9-4a8d-aaa3-c110e1c6085d tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:08:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7ea851c2-b5d9-4a8d-aaa3-c110e1c6085d tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:08:43 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-7ea851c2-b5d9-4a8d-aaa3-c110e1c6085d tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:08:43 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-d02c2684-702f-4d10-8062-1d2fa343d811 req-068b602c-ae1c-4f4a-a73a-2519b87a6406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d751ef5-bdbe-4b26-9499-5e17b63de0bb", "name": "network-vif-unplugged", "status": "completed", "tag": "bcdd6d2c-9283-4da8-b5b7-7f4311803431"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:08:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d02c2684-702f-4d10-8062-1d2fa343d811 req-068b602c-ae1c-4f4a-a73a-2519b87a6406 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:08:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d02c2684-702f-4d10-8062-1d2fa343d811 req-068b602c-ae1c-4f4a-a73a-2519b87a6406 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:08:43 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-d02c2684-702f-4d10-8062-1d2fa343d811 req-068b602c-ae1c-4f4a-a73a-2519b87a6406 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:08:43 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-d02c2684-702f-4d10-8062-1d2fa343d811 req-068b602c-ae1c-4f4a-a73a-2519b87a6406 service nova] Creating event network-vif-unplugged:bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb on user Apr 12 01:08:43 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-d02c2684-702f-4d10-8062-1d2fa343d811 req-068b602c-ae1c-4f4a-a73a-2519b87a6406 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030383 Apr 12 01:08:43 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 374/1117] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:08:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:08:43 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-7ea851c2-b5d9-4a8d-aaa3-c110e1c6085d tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8bacd3b6194651bc5820c3221ed45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9933281dea437cbaae1040fa06ff06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 01:08:43 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-7ea851c2-b5d9-4a8d-aaa3-c110e1c6085d tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb" status: 200 len: 1665 microversion: 2.1 time: 0.369248 Apr 12 01:08:43 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 374/1118] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:08:43 2023] GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb => generated 1665 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 01:08:45 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-40dac294-b30f-47e6-9f41-ae517c6f6df3 req-1c2f5ee0-4ef8-4652-ae2b-ba5201e3e607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d751ef5-bdbe-4b26-9499-5e17b63de0bb", "name": "network-vif-plugged", "status": "completed", "tag": "bcdd6d2c-9283-4da8-b5b7-7f4311803431"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:08:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-40dac294-b30f-47e6-9f41-ae517c6f6df3 req-1c2f5ee0-4ef8-4652-ae2b-ba5201e3e607 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:08:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-40dac294-b30f-47e6-9f41-ae517c6f6df3 req-1c2f5ee0-4ef8-4652-ae2b-ba5201e3e607 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:08:45 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-40dac294-b30f-47e6-9f41-ae517c6f6df3 req-1c2f5ee0-4ef8-4652-ae2b-ba5201e3e607 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:08:45 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-40dac294-b30f-47e6-9f41-ae517c6f6df3 req-1c2f5ee0-4ef8-4652-ae2b-ba5201e3e607 service nova] Creating event network-vif-plugged:bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb on user Apr 12 01:08:45 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-40dac294-b30f-47e6-9f41-ae517c6f6df3 req-1c2f5ee0-4ef8-4652-ae2b-ba5201e3e607 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032351 Apr 12 01:08:45 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 371/1119] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:08:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:09:33 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-cace5169-2c23-4e6f-afb9-f9b5478fd124 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:09:33 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-cace5169-2c23-4e6f-afb9-f9b5478fd124 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:09:33 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:09:33 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:09:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-cace5169-2c23-4e6f-afb9-f9b5478fd124 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:09:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-cace5169-2c23-4e6f-afb9-f9b5478fd124 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:09:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-cace5169-2c23-4e6f-afb9-f9b5478fd124 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:09:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-cace5169-2c23-4e6f-afb9-f9b5478fd124 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:09:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-cace5169-2c23-4e6f-afb9-f9b5478fd124 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:09:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-cace5169-2c23-4e6f-afb9-f9b5478fd124 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:09:33 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-cace5169-2c23-4e6f-afb9-f9b5478fd124 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8bacd3b6194651bc5820c3221ed45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9933281dea437cbaae1040fa06ff06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 01:09:33 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-cace5169-2c23-4e6f-afb9-f9b5478fd124 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb" status: 200 len: 1642 microversion: 2.1 time: 0.191978 Apr 12 01:09:33 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 375/1120] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:09:33 2023] GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb => generated 1642 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 01:10:33 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:10:33 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=6 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:10:33 user devstack@n-api.service[72494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 01:10:33 user devstack@n-api.service[72494]: Wed Apr 12 01:10:33 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/action (ip 10.0.0.210) !!! Apr 12 01:10:33 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:10:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:10:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:10:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:10:33 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Going to try to start instance {{(pid=72494) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 12 01:10:33 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-2476e658-ad7b-4c9a-9ad4-8483cbd91af5 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/action" status: 202 len: 0 microversion: 2.1 time: 0.086092 Apr 12 01:10:33 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 375/1121] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 01:10:33 2023] POST /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 01:10:34 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=4 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:10:34 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:10:34 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-4c19f067-221a-4df3-9527-9001c2bffe83 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:10:34 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-4c19f067-221a-4df3-9527-9001c2bffe83 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:10:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-4c19f067-221a-4df3-9527-9001c2bffe83 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:10:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-4c19f067-221a-4df3-9527-9001c2bffe83 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:10:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-4c19f067-221a-4df3-9527-9001c2bffe83 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:10:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-4c19f067-221a-4df3-9527-9001c2bffe83 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:10:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-4c19f067-221a-4df3-9527-9001c2bffe83 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:10:34 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-4c19f067-221a-4df3-9527-9001c2bffe83 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:10:34 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-4c19f067-221a-4df3-9527-9001c2bffe83 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8bacd3b6194651bc5820c3221ed45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9933281dea437cbaae1040fa06ff06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 01:10:34 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-4c19f067-221a-4df3-9527-9001c2bffe83 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb" status: 200 len: 1651 microversion: 2.1 time: 0.231728 Apr 12 01:10:34 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 372/1122] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:10:34 2023] GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb => generated 1651 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 01:10:36 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:10:36 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:10:36 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-76a69434-7971-41d1-be49-ef5ceb006962 req-c20b17b2-6a13-4ffe-a074-e52d7c393ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d751ef5-bdbe-4b26-9499-5e17b63de0bb", "name": "network-vif-plugged", "status": "completed", "tag": "bcdd6d2c-9283-4da8-b5b7-7f4311803431"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:10:36 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-76a69434-7971-41d1-be49-ef5ceb006962 req-c20b17b2-6a13-4ffe-a074-e52d7c393ff9 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:10:36 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-76a69434-7971-41d1-be49-ef5ceb006962 req-c20b17b2-6a13-4ffe-a074-e52d7c393ff9 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:10:36 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-76a69434-7971-41d1-be49-ef5ceb006962 req-c20b17b2-6a13-4ffe-a074-e52d7c393ff9 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:10:36 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-76a69434-7971-41d1-be49-ef5ceb006962 req-c20b17b2-6a13-4ffe-a074-e52d7c393ff9 service nova] Creating event network-vif-plugged:bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb on user Apr 12 01:10:36 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-76a69434-7971-41d1-be49-ef5ceb006962 req-c20b17b2-6a13-4ffe-a074-e52d7c393ff9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053606 Apr 12 01:10:36 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 376/1123] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:10:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:10:38 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-314c1579-0456-43b0-a377-68b99f10a84f req-bdea864c-af7b-4dd4-a057-8de6fca9206f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d751ef5-bdbe-4b26-9499-5e17b63de0bb", "name": "network-vif-plugged", "status": "completed", "tag": "bcdd6d2c-9283-4da8-b5b7-7f4311803431"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:10:38 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-314c1579-0456-43b0-a377-68b99f10a84f req-bdea864c-af7b-4dd4-a057-8de6fca9206f service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:10:38 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-314c1579-0456-43b0-a377-68b99f10a84f req-bdea864c-af7b-4dd4-a057-8de6fca9206f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:10:38 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-314c1579-0456-43b0-a377-68b99f10a84f req-bdea864c-af7b-4dd4-a057-8de6fca9206f service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:10:38 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-314c1579-0456-43b0-a377-68b99f10a84f req-bdea864c-af7b-4dd4-a057-8de6fca9206f service nova] Creating event network-vif-plugged:bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb on user Apr 12 01:10:38 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-314c1579-0456-43b0-a377-68b99f10a84f req-bdea864c-af7b-4dd4-a057-8de6fca9206f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031523 Apr 12 01:10:38 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 376/1124] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:10:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 01:11:24 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-3a67f61e-288a-476e-a05e-6b8bbab40625 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:11:24 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-3a67f61e-288a-476e-a05e-6b8bbab40625 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:11:24 user devstack@n-api.service[72495]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d204f24b-50e4-4145-ba20-980194a55823] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 12 01:11:24 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:11:24 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:11:24 user devstack@n-api.service[72495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 12 01:11:24 user devstack@n-api.service[72495]: Wed Apr 12 01:11:24 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb (ip 10.0.0.210) !!! Apr 12 01:11:24 user devstack@n-api.service[72495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 12 01:11:24 user devstack@n-api.service[72495]: Wed Apr 12 01:11:24 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb (ip 10.0.0.210) !!! Apr 12 01:11:24 user devstack@n-api.service[72495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 12 01:11:24 user devstack@n-api.service[72495]: Wed Apr 12 01:11:24 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb (ip 10.0.0.210) !!! Apr 12 01:11:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-3a67f61e-288a-476e-a05e-6b8bbab40625 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:11:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-3a67f61e-288a-476e-a05e-6b8bbab40625 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:11:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-3a67f61e-288a-476e-a05e-6b8bbab40625 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:11:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-3a67f61e-288a-476e-a05e-6b8bbab40625 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:11:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-3a67f61e-288a-476e-a05e-6b8bbab40625 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:11:24 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-3a67f61e-288a-476e-a05e-6b8bbab40625 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:11:24 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-3a67f61e-288a-476e-a05e-6b8bbab40625 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8bacd3b6194651bc5820c3221ed45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9933281dea437cbaae1040fa06ff06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 01:11:24 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-3a67f61e-288a-476e-a05e-6b8bbab40625 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb" status: 200 len: 1655 microversion: 2.1 time: 0.334494 Apr 12 01:11:24 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 373/1125] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:11:24 2023] GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb => generated 1655 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 01:12:24 user devstack@n-api.service[72496]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6bfc0271-d05f-4d2a-a131-4a3004ff6be5] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 01:12:24 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:12:24 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:12:24 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-48365783-331f-4a96-a7ea-58b27be3735b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:12:24 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-48365783-331f-4a96-a7ea-58b27be3735b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:12:24 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-48365783-331f-4a96-a7ea-58b27be3735b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:12:24 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-48365783-331f-4a96-a7ea-58b27be3735b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:12:24 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-48365783-331f-4a96-a7ea-58b27be3735b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:12:24 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-48365783-331f-4a96-a7ea-58b27be3735b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:12:24 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-48365783-331f-4a96-a7ea-58b27be3735b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:12:24 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-48365783-331f-4a96-a7ea-58b27be3735b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:12:24 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-48365783-331f-4a96-a7ea-58b27be3735b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079014 Apr 12 01:12:24 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 377/1126] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 01:12:24 2023] GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 12 01:12:24 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=4 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:12:25 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:12:25 user devstack@n-api.service[72494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 01:12:25 user devstack@n-api.service[72494]: Wed Apr 12 01:12:25 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb (ip 10.0.0.210) !!! Apr 12 01:12:25 user devstack@n-api.service[72494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 01:12:25 user devstack@n-api.service[72494]: Wed Apr 12 01:12:25 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb (ip 10.0.0.210) !!! Apr 12 01:12:25 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:12:25 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:12:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:12:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:12:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:12:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:12:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:12:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:12:25 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Going to try to terminate instance {{(pid=72494) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 01:12:25 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-449ad798-93c7-46a6-a2a1-e25b81406d00 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb" status: 204 len: 0 microversion: 2.1 time: 0.172283 Apr 12 01:12:25 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 377/1127] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 01:12:24 2023] DELETE /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 01:12:25 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:12:25 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:12:25 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-0a2ff662-e13b-43ce-97af-175a4a6ab302 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:12:25 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-0a2ff662-e13b-43ce-97af-175a4a6ab302 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:12:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-0a2ff662-e13b-43ce-97af-175a4a6ab302 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:12:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-0a2ff662-e13b-43ce-97af-175a4a6ab302 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:12:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-0a2ff662-e13b-43ce-97af-175a4a6ab302 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:12:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-0a2ff662-e13b-43ce-97af-175a4a6ab302 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:12:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-0a2ff662-e13b-43ce-97af-175a4a6ab302 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:12:25 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-0a2ff662-e13b-43ce-97af-175a4a6ab302 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:12:25 user devstack@n-api.service[72495]: INFO oslo.messaging._drivers.impl_rabbit [-] [d204f24b-50e4-4145-ba20-980194a55823] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 41926. Apr 12 01:12:25 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-ac0dadde-d3f0-4409-a887-0f354dcc3d6f req-08fafe93-f38f-4f16-8319-f3bb4758b95e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d751ef5-bdbe-4b26-9499-5e17b63de0bb", "name": "network-vif-unplugged", "status": "completed", "tag": "bcdd6d2c-9283-4da8-b5b7-7f4311803431"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:12:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-ac0dadde-d3f0-4409-a887-0f354dcc3d6f req-08fafe93-f38f-4f16-8319-f3bb4758b95e service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:12:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-ac0dadde-d3f0-4409-a887-0f354dcc3d6f req-08fafe93-f38f-4f16-8319-f3bb4758b95e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:12:25 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-ac0dadde-d3f0-4409-a887-0f354dcc3d6f req-08fafe93-f38f-4f16-8319-f3bb4758b95e service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:12:25 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-ac0dadde-d3f0-4409-a887-0f354dcc3d6f req-08fafe93-f38f-4f16-8319-f3bb4758b95e service nova] Creating event network-vif-unplugged:bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb on user Apr 12 01:12:25 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-ac0dadde-d3f0-4409-a887-0f354dcc3d6f req-08fafe93-f38f-4f16-8319-f3bb4758b95e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103781 Apr 12 01:12:25 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 378/1128] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:12:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:12:25 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-0a2ff662-e13b-43ce-97af-175a4a6ab302 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8bacd3b6194651bc5820c3221ed45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9933281dea437cbaae1040fa06ff06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 01:12:25 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-0a2ff662-e13b-43ce-97af-175a4a6ab302 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb" status: 200 len: 1661 microversion: 2.1 time: 0.527687 Apr 12 01:12:25 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 374/1129] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:12:25 2023] GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb => generated 1661 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 01:12:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-05436e8e-8a85-4da1-8f3b-46a6df5d779d req-95b3939f-90a8-44de-b4b4-fd8f4e2b9b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d751ef5-bdbe-4b26-9499-5e17b63de0bb", "name": "network-vif-deleted", "tag": "bcdd6d2c-9283-4da8-b5b7-7f4311803431"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:12:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-05436e8e-8a85-4da1-8f3b-46a6df5d779d req-95b3939f-90a8-44de-b4b4-fd8f4e2b9b7d service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:12:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-05436e8e-8a85-4da1-8f3b-46a6df5d779d req-95b3939f-90a8-44de-b4b4-fd8f4e2b9b7d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:12:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-05436e8e-8a85-4da1-8f3b-46a6df5d779d req-95b3939f-90a8-44de-b4b4-fd8f4e2b9b7d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:12:27 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-05436e8e-8a85-4da1-8f3b-46a6df5d779d req-95b3939f-90a8-44de-b4b4-fd8f4e2b9b7d service nova] Creating event network-vif-deleted:bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb on user Apr 12 01:12:27 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-05436e8e-8a85-4da1-8f3b-46a6df5d779d req-95b3939f-90a8-44de-b4b4-fd8f4e2b9b7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094878 Apr 12 01:12:27 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 378/1130] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:12:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:12:27 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-04570ca1-ee4b-471f-8a96-b32a054f8d71 req-b241ad35-6c0a-4d2d-aa95-1afb550b0c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d751ef5-bdbe-4b26-9499-5e17b63de0bb", "name": "network-vif-plugged", "status": "completed", "tag": "bcdd6d2c-9283-4da8-b5b7-7f4311803431"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:12:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-04570ca1-ee4b-471f-8a96-b32a054f8d71 req-b241ad35-6c0a-4d2d-aa95-1afb550b0c18 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:12:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-04570ca1-ee4b-471f-8a96-b32a054f8d71 req-b241ad35-6c0a-4d2d-aa95-1afb550b0c18 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:12:27 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-04570ca1-ee4b-471f-8a96-b32a054f8d71 req-b241ad35-6c0a-4d2d-aa95-1afb550b0c18 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:12:27 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-04570ca1-ee4b-471f-8a96-b32a054f8d71 req-b241ad35-6c0a-4d2d-aa95-1afb550b0c18 service nova] Creating event network-vif-plugged:bcdd6d2c-9283-4da8-b5b7-7f4311803431 for instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb on user Apr 12 01:12:27 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-04570ca1-ee4b-471f-8a96-b32a054f8d71 req-b241ad35-6c0a-4d2d-aa95-1afb550b0c18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032231 Apr 12 01:12:27 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 379/1131] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:12:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:13:15 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-59aff0fe-b61a-4ee2-be51-c67351fbc1c3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:13:15 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-59aff0fe-b61a-4ee2-be51-c67351fbc1c3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:13:15 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:13:15 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:13:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-59aff0fe-b61a-4ee2-be51-c67351fbc1c3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:13:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-59aff0fe-b61a-4ee2-be51-c67351fbc1c3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:13:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-59aff0fe-b61a-4ee2-be51-c67351fbc1c3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:13:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-59aff0fe-b61a-4ee2-be51-c67351fbc1c3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:13:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-59aff0fe-b61a-4ee2-be51-c67351fbc1c3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:13:15 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-59aff0fe-b61a-4ee2-be51-c67351fbc1c3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:13:15 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-59aff0fe-b61a-4ee2-be51-c67351fbc1c3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] HTTP exception thrown: Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb could not be found. Apr 12 01:13:15 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-59aff0fe-b61a-4ee2-be51-c67351fbc1c3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Request method failure captured: Apr 12 01:13:15 user devstack@n-api.service[72495]: request: GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb HTTP/1.1 Apr 12 01:13:15 user devstack@n-api.service[72495]: Accept: application/json Apr 12 01:13:15 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 01:13:15 user devstack@n-api.service[72495]: Connection: close Apr 12 01:13:15 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 01:13:15 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 01:13:15 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 01:13:15 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 01:13:15 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 01:13:15 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNgNBRnofMS3zjT5ZniCxnE_v79oL5uKe5dh4nKeYWtxF4PVBe2PqHnmQ9DO_od8CVp-AjsXGMhuuXboZqJKtTXVeMiPUEINJQpslnlcepG5aoUwGVUhF4fCcre2xTI0CentdOWP9inZq1TcXh4WIgqn-l34DKJFWcS64n26caFdVdDg Apr 12 01:13:15 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 01:13:15 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 01:13:15 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 01:13:15 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 01:13:15 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 01:13:15 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 01:13:15 user devstack@n-api.service[72495]: X-Project-Id: 8c9933281dea437cbaae1040fa06ff06 Apr 12 01:13:15 user devstack@n-api.service[72495]: X-Project-Name: tempest-AttachVolumeTestJSON-1807582141 Apr 12 01:13:15 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 01:13:15 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 01:13:15 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c9933281dea437cbaae1040fa06ff06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8c9933281dea437cbaae1040fa06ff06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c9933281dea437cbaae1040fa06ff06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 01:13:15 user devstack@n-api.service[72495]: X-Tenant: tempest-AttachVolumeTestJSON-1807582141 Apr 12 01:13:15 user devstack@n-api.service[72495]: X-Tenant-Id: 8c9933281dea437cbaae1040fa06ff06 Apr 12 01:13:15 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1807582141 Apr 12 01:13:15 user devstack@n-api.service[72495]: X-User: tempest-AttachVolumeTestJSON-1807582141-project-member Apr 12 01:13:15 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 01:13:15 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 01:13:15 user devstack@n-api.service[72495]: X-User-Id: bc8bacd3b6194651bc5820c3221ed45e Apr 12 01:13:15 user devstack@n-api.service[72495]: X-User-Name: tempest-AttachVolumeTestJSON-1807582141-project-member Apr 12 01:13:15 user devstack@n-api.service[72495]: method: > Apr 12 01:13:15 user devstack@n-api.service[72495]: exception: Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb could not be found. Apr 12 01:13:15 user devstack@n-api.service[72495]: action_args: {'id': '9d751ef5-bdbe-4b26-9499-5e17b63de0bb'} Apr 12 01:13:15 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb could not be found. Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb could not be found. Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb could not be found. Apr 12 01:13:15 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:13:15 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-59aff0fe-b61a-4ee2-be51-c67351fbc1c3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Returning 404 to user: Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 01:13:15 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-59aff0fe-b61a-4ee2-be51-c67351fbc1c3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb" status: 404 len: 111 microversion: 2.1 time: 0.043148 Apr 12 01:13:15 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 375/1132] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:13:15 2023] GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 01:13:15 user devstack@n-api.service[72494]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3a1bc446-f0cd-4585-b07d-b5da09904692] AMQP server on 10.0.0.210:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 12 01:13:15 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:13:15 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:13:15 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-81fbc88a-1d9a-46b8-8c6c-b40197ba6614 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '.version_select at 0x7f7cd477caf0>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:13:15 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-81fbc88a-1d9a-46b8-8c6c-b40197ba6614 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-405999562" status: 202 len: 0 microversion: 2.1 time: 0.032869 Apr 12 01:13:15 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 379/1133] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 01:13:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-405999562 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 01:13:16 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:13:16 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=10 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:13:16 user devstack@n-api.service[72496]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 12 01:13:16 user devstack@n-api.service[72496]: Wed Apr 12 01:13:16 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Apr 12 01:13:16 user devstack@n-api.service[72496]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 12 01:13:16 user devstack@n-api.service[72496]: Wed Apr 12 01:13:16 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Apr 12 01:13:16 user devstack@n-api.service[72496]: INFO oslo.messaging._drivers.impl_rabbit [-] [6bfc0271-d05f-4d2a-a131-4a3004ff6be5] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 41938. Apr 12 01:13:16 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-bc778a4a-efc3-4864-9815-d8eb95855cef tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Action: 'create', calling method: .version_select at 0x7f7cd47cf250>, body: {"keypair": {"name": "tempest-keypair-1597493578", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnQ81yiH2IPtrrq5dVXYilo1OCQ+NjEjsGj2vbhpQk8OCME5dD4DDx8chQjke0l7IHjohX8YSoXjWERAWr2t9d5s5rwogAKtGecdi2acJpjCBHGA2Dq+V0nRhsccXfCMw=="}} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:13:16 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-bc778a4a-efc3-4864-9815-d8eb95855cef tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Getting quotas for project 8c9933281dea437cbaae1040fa06ff06. Resources: {'key_pairs'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 01:13:16 user devstack@n-api.service[72496]: DEBUG nova.quota [None req-bc778a4a-efc3-4864-9815-d8eb95855cef tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Getting quotas for user bc8bacd3b6194651bc5820c3221ed45e and project 8c9933281dea437cbaae1040fa06ff06. Resources: {'key_pairs'} {{(pid=72496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 01:13:16 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-bc778a4a-efc3-4864-9815-d8eb95855cef tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074187 Apr 12 01:13:16 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 380/1134] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 01:13:16 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:13:18 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-717569489", "imageRef": "7ae54858-7fe8-4bde-be8c-1b0f88b691ea", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "82994dcf-29f7-4699-a7ae-6ea95516c04f"}], "security_groups": [{"name": "tempest-securitygroup--1356326655"}], "key_name": "tempest-keypair-1597493578", "user_data": "}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:13:18 user devstack@n-api.service[72495]: DEBUG nova.network.neutron [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] validate_networks() for [('82994dcf-29f7-4699-a7ae-6ea95516c04f', None, None, None, None, None)] {{(pid=72495) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 01:13:18 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Flavor limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 01:13:18 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Image limits 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 01:13:18 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Flavor pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 01:13:18 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Image pref 0:0:0 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 01:13:18 user devstack@n-api.service[72495]: DEBUG nova.virt.hardware [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72495) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 01:13:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:13:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:13:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:13:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:13:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:13:18 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:13:18 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Getting quotas for project 8c9933281dea437cbaae1040fa06ff06. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 01:13:18 user devstack@n-api.service[72495]: DEBUG nova.quota [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Getting quotas for user bc8bacd3b6194651bc5820c3221ed45e and project 8c9933281dea437cbaae1040fa06ff06. Resources: {'ram', 'cores', 'instances'} {{(pid=72495) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 01:13:18 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Going to run 1 instances... {{(pid=72495) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 01:13:18 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ae54858-7fe8-4bde-be8c-1b0f88b691ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72495) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 01:13:18 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-345e15bc-c619-479e-bee0-2d9176f7761e tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.640058 Apr 12 01:13:18 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 376/1135] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 01:13:18 2023] POST /compute/v2.1/servers => generated 400 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 01:13:18 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-8bde74f6-5a0d-4d06-ad90-05af1930f6b2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:13:18 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-8bde74f6-5a0d-4d06-ad90-05af1930f6b2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:13:18 user devstack@n-api.service[72494]: INFO oslo.messaging._drivers.impl_rabbit [-] [3a1bc446-f0cd-4585-b07d-b5da09904692] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 56052. Apr 12 01:13:18 user devstack@n-api.service[72494]: DEBUG nova.policy [None req-8bde74f6-5a0d-4d06-ad90-05af1930f6b2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8bacd3b6194651bc5820c3221ed45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9933281dea437cbaae1040fa06ff06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72494) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 01:13:18 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-8bde74f6-5a0d-4d06-ad90-05af1930f6b2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053" status: 200 len: 1231 microversion: 2.1 time: 0.071670 Apr 12 01:13:18 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 380/1136] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:13:18 2023] GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053 => generated 1231 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 01:13:21 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-2cbf8ce6-30c6-459e-8f2e-5b5e170c82da req-e2eb7893-2f0c-4fb5-a7d5-8a6da938854a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72a31d24-b6f0-4a08-bdab-b16e23127053", "tag": "978785eb-1a68-4a8b-8417-66e0a8b13937"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:13:21 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2cbf8ce6-30c6-459e-8f2e-5b5e170c82da req-e2eb7893-2f0c-4fb5-a7d5-8a6da938854a service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:13:21 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2cbf8ce6-30c6-459e-8f2e-5b5e170c82da req-e2eb7893-2f0c-4fb5-a7d5-8a6da938854a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:13:21 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-2cbf8ce6-30c6-459e-8f2e-5b5e170c82da req-e2eb7893-2f0c-4fb5-a7d5-8a6da938854a service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:13:21 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-2cbf8ce6-30c6-459e-8f2e-5b5e170c82da req-e2eb7893-2f0c-4fb5-a7d5-8a6da938854a service nova] Creating event network-changed:978785eb-1a68-4a8b-8417-66e0a8b13937 for instance 72a31d24-b6f0-4a08-bdab-b16e23127053 on user Apr 12 01:13:21 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-2cbf8ce6-30c6-459e-8f2e-5b5e170c82da req-e2eb7893-2f0c-4fb5-a7d5-8a6da938854a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033952 Apr 12 01:13:21 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 381/1137] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:13:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:13:22 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-731de9a5-6c75-46ae-83e3-a3e49b902cac req-e7880a3a-f3b2-45ca-9558-2e1a84d2f220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72a31d24-b6f0-4a08-bdab-b16e23127053", "name": "network-vif-plugged", "status": "completed", "tag": "978785eb-1a68-4a8b-8417-66e0a8b13937"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:13:22 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-731de9a5-6c75-46ae-83e3-a3e49b902cac req-e7880a3a-f3b2-45ca-9558-2e1a84d2f220 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:13:22 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-731de9a5-6c75-46ae-83e3-a3e49b902cac req-e7880a3a-f3b2-45ca-9558-2e1a84d2f220 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:13:22 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-731de9a5-6c75-46ae-83e3-a3e49b902cac req-e7880a3a-f3b2-45ca-9558-2e1a84d2f220 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:13:22 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-731de9a5-6c75-46ae-83e3-a3e49b902cac req-e7880a3a-f3b2-45ca-9558-2e1a84d2f220 service nova] Creating event network-vif-plugged:978785eb-1a68-4a8b-8417-66e0a8b13937 for instance 72a31d24-b6f0-4a08-bdab-b16e23127053 on user Apr 12 01:13:23 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-731de9a5-6c75-46ae-83e3-a3e49b902cac req-e7880a3a-f3b2-45ca-9558-2e1a84d2f220 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047498 Apr 12 01:13:23 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 377/1138] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:13:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:13:25 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-2e0ea4fa-7ad7-462f-9384-9d02cb546eb6 req-739f1cd3-2554-470a-8ca2-44233190f96b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72a31d24-b6f0-4a08-bdab-b16e23127053", "name": "network-vif-plugged", "status": "completed", "tag": "978785eb-1a68-4a8b-8417-66e0a8b13937"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:13:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-2e0ea4fa-7ad7-462f-9384-9d02cb546eb6 req-739f1cd3-2554-470a-8ca2-44233190f96b service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:13:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-2e0ea4fa-7ad7-462f-9384-9d02cb546eb6 req-739f1cd3-2554-470a-8ca2-44233190f96b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:13:25 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-2e0ea4fa-7ad7-462f-9384-9d02cb546eb6 req-739f1cd3-2554-470a-8ca2-44233190f96b service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:13:25 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-2e0ea4fa-7ad7-462f-9384-9d02cb546eb6 req-739f1cd3-2554-470a-8ca2-44233190f96b service nova] Creating event network-vif-plugged:978785eb-1a68-4a8b-8417-66e0a8b13937 for instance 72a31d24-b6f0-4a08-bdab-b16e23127053 on user Apr 12 01:13:25 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-2e0ea4fa-7ad7-462f-9384-9d02cb546eb6 req-739f1cd3-2554-470a-8ca2-44233190f96b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041959 Apr 12 01:13:25 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 381/1139] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:13:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:14:08 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell0:SELECT=4 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:14:08 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:14:08 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:14:09 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-ec5d3bf2-56de-4cb5-b109-6a2106196ef7 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:14:09 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-ec5d3bf2-56de-4cb5-b109-6a2106196ef7 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:14:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-ec5d3bf2-56de-4cb5-b109-6a2106196ef7 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:14:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-ec5d3bf2-56de-4cb5-b109-6a2106196ef7 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:14:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-ec5d3bf2-56de-4cb5-b109-6a2106196ef7 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:14:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-ec5d3bf2-56de-4cb5-b109-6a2106196ef7 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:14:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-ec5d3bf2-56de-4cb5-b109-6a2106196ef7 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:14:09 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-ec5d3bf2-56de-4cb5-b109-6a2106196ef7 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:14:09 user devstack@n-api.service[72496]: DEBUG nova.policy [None req-ec5d3bf2-56de-4cb5-b109-6a2106196ef7 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8bacd3b6194651bc5820c3221ed45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9933281dea437cbaae1040fa06ff06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72496) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 01:14:09 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-ec5d3bf2-56de-4cb5-b109-6a2106196ef7 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053" status: 200 len: 1536 microversion: 2.1 time: 0.339244 Apr 12 01:14:09 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 382/1140] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:14:08 2023] GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053 => generated 1536 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 01:15:09 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=2 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:15:09 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell0:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:15:09 user devstack@n-api.service[72495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 01:15:09 user devstack@n-api.service[72495]: Wed Apr 12 01:15:09 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-interface (ip 10.0.0.210) !!! Apr 12 01:15:09 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:15:09 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=6 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:15:09 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-8eeb96fa-afc8-4bc3-acad-7aebe09cedb8 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:15:09 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-8eeb96fa-afc8-4bc3-acad-7aebe09cedb8 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:15:09 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8eeb96fa-afc8-4bc3-acad-7aebe09cedb8 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:09 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8eeb96fa-afc8-4bc3-acad-7aebe09cedb8 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:09 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8eeb96fa-afc8-4bc3-acad-7aebe09cedb8 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:09 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8eeb96fa-afc8-4bc3-acad-7aebe09cedb8 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:09 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8eeb96fa-afc8-4bc3-acad-7aebe09cedb8 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:09 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-8eeb96fa-afc8-4bc3-acad-7aebe09cedb8 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:09 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-8eeb96fa-afc8-4bc3-acad-7aebe09cedb8 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.132819 Apr 12 01:15:09 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 378/1141] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 01:15:09 2023] GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-interface => generated 282 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:15:10 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell0:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:15:10 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:15:10 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=2 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:15:10 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:15:10 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=6 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:15:10 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-181fec9d-40b6-4988-8535-9a13a42093b2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:15:10 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-181fec9d-40b6-4988-8535-9a13a42093b2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:15:10 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-e419363f-4ae7-44ba-94fb-436042038eae req-4a1a011c-25da-4671-9c60-4c005e6fcfbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72a31d24-b6f0-4a08-bdab-b16e23127053", "tag": "978785eb-1a68-4a8b-8417-66e0a8b13937"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:15:10 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-181fec9d-40b6-4988-8535-9a13a42093b2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:10 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-181fec9d-40b6-4988-8535-9a13a42093b2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:10 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-181fec9d-40b6-4988-8535-9a13a42093b2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:10 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-181fec9d-40b6-4988-8535-9a13a42093b2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:10 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-181fec9d-40b6-4988-8535-9a13a42093b2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:10 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-181fec9d-40b6-4988-8535-9a13a42093b2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:10 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-e419363f-4ae7-44ba-94fb-436042038eae req-4a1a011c-25da-4671-9c60-4c005e6fcfbb service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:10 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-e419363f-4ae7-44ba-94fb-436042038eae req-4a1a011c-25da-4671-9c60-4c005e6fcfbb service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:10 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-e419363f-4ae7-44ba-94fb-436042038eae req-4a1a011c-25da-4671-9c60-4c005e6fcfbb service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:10 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-e419363f-4ae7-44ba-94fb-436042038eae req-4a1a011c-25da-4671-9c60-4c005e6fcfbb service nova] Creating event network-changed:978785eb-1a68-4a8b-8417-66e0a8b13937 for instance 72a31d24-b6f0-4a08-bdab-b16e23127053 on user Apr 12 01:15:10 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-e419363f-4ae7-44ba-94fb-436042038eae req-4a1a011c-25da-4671-9c60-4c005e6fcfbb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102936 Apr 12 01:15:10 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 382/1142] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:15:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:15:10 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-181fec9d-40b6-4988-8535-9a13a42093b2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/ips" status: 200 len: 103 microversion: 2.1 time: 0.063842 Apr 12 01:15:10 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 383/1143] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 01:15:10 2023] GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/ips => generated 103 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:15:11 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e5f6748-3a26-48ee-bd0b-af4ab486825d"}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:15:11 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:15:11 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:11 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:11 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:11 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:11 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:11 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:12 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-c6555ea1-dd7d-49b8-8ebf-229567663839 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "POST /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305555 Apr 12 01:15:12 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 379/1144] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 01:15:11 2023] POST /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:15:19 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-f65a07a9-e61d-4925-b202-74ce6f1f1145 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:15:19 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-f65a07a9-e61d-4925-b202-74ce6f1f1145 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:15:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f65a07a9-e61d-4925-b202-74ce6f1f1145 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f65a07a9-e61d-4925-b202-74ce6f1f1145 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f65a07a9-e61d-4925-b202-74ce6f1f1145 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f65a07a9-e61d-4925-b202-74ce6f1f1145 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f65a07a9-e61d-4925-b202-74ce6f1f1145 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:19 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-f65a07a9-e61d-4925-b202-74ce6f1f1145 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:19 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-f65a07a9-e61d-4925-b202-74ce6f1f1145 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049678 Apr 12 01:15:19 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 383/1145] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 01:15:19 2023] GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:15:19 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-b870ccdb-c23b-4da7-adb6-defe01dde491 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:15:19 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-b870ccdb-c23b-4da7-adb6-defe01dde491 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:15:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b870ccdb-c23b-4da7-adb6-defe01dde491 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b870ccdb-c23b-4da7-adb6-defe01dde491 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b870ccdb-c23b-4da7-adb6-defe01dde491 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b870ccdb-c23b-4da7-adb6-defe01dde491 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b870ccdb-c23b-4da7-adb6-defe01dde491 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:19 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-b870ccdb-c23b-4da7-adb6-defe01dde491 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:19 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-b870ccdb-c23b-4da7-adb6-defe01dde491 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-volume_attachments/7e5f6748-3a26-48ee-bd0b-af4ab486825d" status: 200 len: 194 microversion: 2.1 time: 0.047608 Apr 12 01:15:19 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 384/1146] 10.0.0.210 () {62 vars in 1490 bytes} [Wed Apr 12 01:15:19 2023] GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-volume_attachments/7e5f6748-3a26-48ee-bd0b-af4ab486825d => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:15:21 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a9226ef-a2fc-49ca-b581-7c37a88e7b9d"}} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:15:21 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:15:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:21 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:21 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-2f42e83d-6308-47e2-bf55-41d297808535 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "POST /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304594 Apr 12 01:15:21 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 380/1147] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 01:15:21 2023] POST /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:15:27 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-53279bd8-49db-4d62-af38-feb80110ce9d tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:15:27 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-53279bd8-49db-4d62-af38-feb80110ce9d tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:15:27 user devstack@n-api.service[72494]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 12 01:15:27 user devstack@n-api.service[72494]: Wed Apr 12 01:15:27 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-volume_attachments (ip 10.0.0.210) !!! Apr 12 01:15:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-53279bd8-49db-4d62-af38-feb80110ce9d tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-53279bd8-49db-4d62-af38-feb80110ce9d tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-53279bd8-49db-4d62-af38-feb80110ce9d tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-53279bd8-49db-4d62-af38-feb80110ce9d tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-53279bd8-49db-4d62-af38-feb80110ce9d tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:27 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-53279bd8-49db-4d62-af38-feb80110ce9d tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:27 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-53279bd8-49db-4d62-af38-feb80110ce9d tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049512 Apr 12 01:15:27 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 384/1148] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 01:15:27 2023] GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:15:28 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-3e4d9efa-d337-4bf3-a462-3290d3ef9231 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:15:28 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-3e4d9efa-d337-4bf3-a462-3290d3ef9231 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:15:28 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-3e4d9efa-d337-4bf3-a462-3290d3ef9231 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:28 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-3e4d9efa-d337-4bf3-a462-3290d3ef9231 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:28 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-3e4d9efa-d337-4bf3-a462-3290d3ef9231 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:28 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-3e4d9efa-d337-4bf3-a462-3290d3ef9231 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:28 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-3e4d9efa-d337-4bf3-a462-3290d3ef9231 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:28 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-3e4d9efa-d337-4bf3-a462-3290d3ef9231 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:28 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-3e4d9efa-d337-4bf3-a462-3290d3ef9231 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-volume_attachments/7e5f6748-3a26-48ee-bd0b-af4ab486825d" status: 200 len: 194 microversion: 2.1 time: 0.091553 Apr 12 01:15:28 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 385/1149] 10.0.0.210 () {62 vars in 1490 bytes} [Wed Apr 12 01:15:27 2023] GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-volume_attachments/7e5f6748-3a26-48ee-bd0b-af4ab486825d => generated 194 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:15:28 user devstack@n-api.service[72495]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 12 01:15:28 user devstack@n-api.service[72495]: Wed Apr 12 01:15:28 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-volume_attachments/7e5f6748-3a26-48ee-bd0b-af4ab486825d (ip 10.0.0.210) !!! Apr 12 01:15:28 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:15:28 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:15:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:28 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:28 user devstack@n-api.service[72495]: DEBUG nova.objects.instance [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'services' on Instance uuid 72a31d24-b6f0-4a08-bdab-b16e23127053 {{(pid=72495) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 01:15:28 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-fcc19f5b-f065-4204-a1c1-c2f056a24dde tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-volume_attachments/7e5f6748-3a26-48ee-bd0b-af4ab486825d" status: 202 len: 0 microversion: 2.1 time: 0.173537 Apr 12 01:15:28 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 381/1150] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 01:15:28 2023] DELETE /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-volume_attachments/7e5f6748-3a26-48ee-bd0b-af4ab486825d => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 01:15:30 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-72bce3ac-3ef2-4dc1-bf88-de5f24b7f7c1 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:15:30 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-72bce3ac-3ef2-4dc1-bf88-de5f24b7f7c1 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:15:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-72bce3ac-3ef2-4dc1-bf88-de5f24b7f7c1 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-72bce3ac-3ef2-4dc1-bf88-de5f24b7f7c1 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-72bce3ac-3ef2-4dc1-bf88-de5f24b7f7c1 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-72bce3ac-3ef2-4dc1-bf88-de5f24b7f7c1 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-72bce3ac-3ef2-4dc1-bf88-de5f24b7f7c1 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:30 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-72bce3ac-3ef2-4dc1-bf88-de5f24b7f7c1 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:30 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-72bce3ac-3ef2-4dc1-bf88-de5f24b7f7c1 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-volume_attachments/7a9226ef-a2fc-49ca-b581-7c37a88e7b9d" status: 200 len: 194 microversion: 2.1 time: 0.039761 Apr 12 01:15:30 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 385/1151] 10.0.0.210 () {62 vars in 1490 bytes} [Wed Apr 12 01:15:30 2023] GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-volume_attachments/7a9226ef-a2fc-49ca-b581-7c37a88e7b9d => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:15:30 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:15:30 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:15:30 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:30 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:30 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:30 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:30 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:30 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:30 user devstack@n-api.service[72496]: DEBUG nova.objects.instance [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lazy-loading 'services' on Instance uuid 72a31d24-b6f0-4a08-bdab-b16e23127053 {{(pid=72496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 01:15:30 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-164da81b-f07e-40a6-9b96-51fdc2681fa3 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-volume_attachments/7a9226ef-a2fc-49ca-b581-7c37a88e7b9d" status: 202 len: 0 microversion: 2.1 time: 0.255929 Apr 12 01:15:30 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 386/1152] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 01:15:30 2023] DELETE /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-volume_attachments/7a9226ef-a2fc-49ca-b581-7c37a88e7b9d => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 01:15:33 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-b40450d4-83ff-46b8-9955-6d936ddd02a0 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:15:33 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-b40450d4-83ff-46b8-9955-6d936ddd02a0 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:15:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b40450d4-83ff-46b8-9955-6d936ddd02a0 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b40450d4-83ff-46b8-9955-6d936ddd02a0 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b40450d4-83ff-46b8-9955-6d936ddd02a0 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b40450d4-83ff-46b8-9955-6d936ddd02a0 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b40450d4-83ff-46b8-9955-6d936ddd02a0 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-b40450d4-83ff-46b8-9955-6d936ddd02a0 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:33 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-b40450d4-83ff-46b8-9955-6d936ddd02a0 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043932 Apr 12 01:15:33 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 382/1153] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 01:15:33 2023] GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 01:15:33 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-9fd1bc81-9cbf-4095-9ec9-f65d02c0e8dd tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:15:33 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-9fd1bc81-9cbf-4095-9ec9-f65d02c0e8dd tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:15:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9fd1bc81-9cbf-4095-9ec9-f65d02c0e8dd tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9fd1bc81-9cbf-4095-9ec9-f65d02c0e8dd tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9fd1bc81-9cbf-4095-9ec9-f65d02c0e8dd tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9fd1bc81-9cbf-4095-9ec9-f65d02c0e8dd tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9fd1bc81-9cbf-4095-9ec9-f65d02c0e8dd tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-9fd1bc81-9cbf-4095-9ec9-f65d02c0e8dd tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:33 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-9fd1bc81-9cbf-4095-9ec9-f65d02c0e8dd tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039082 Apr 12 01:15:33 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 386/1154] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 01:15:33 2023] GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053/os-volume_attachments => generated 25 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 01:15:33 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:15:33 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:15:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:33 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:33 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Going to try to terminate instance {{(pid=72496) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 01:15:33 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-0df2c06f-e43c-4a05-8fbd-05072f8ad95b tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053" status: 204 len: 0 microversion: 2.1 time: 0.123981 Apr 12 01:15:33 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 387/1155] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 01:15:33 2023] DELETE /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 01:15:33 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-be76d8fb-e131-47d6-b655-53aa7be01c13 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:15:33 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-be76d8fb-e131-47d6-b655-53aa7be01c13 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:15:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-be76d8fb-e131-47d6-b655-53aa7be01c13 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-be76d8fb-e131-47d6-b655-53aa7be01c13 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-be76d8fb-e131-47d6-b655-53aa7be01c13 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-be76d8fb-e131-47d6-b655-53aa7be01c13 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-be76d8fb-e131-47d6-b655-53aa7be01c13 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:33 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-be76d8fb-e131-47d6-b655-53aa7be01c13 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:33 user devstack@n-api.service[72495]: DEBUG nova.policy [None req-be76d8fb-e131-47d6-b655-53aa7be01c13 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8bacd3b6194651bc5820c3221ed45e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9933281dea437cbaae1040fa06ff06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72495) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 01:15:33 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-be76d8fb-e131-47d6-b655-53aa7be01c13 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053" status: 200 len: 1661 microversion: 2.1 time: 0.209331 Apr 12 01:15:33 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 383/1156] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:15:33 2023] GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053 => generated 1661 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 01:15:33 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [req-6a174ea1-e4fa-476b-bf69-49a29ec3005e req-1f3ffa43-35e0-4f8a-a100-d4821918371d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72a31d24-b6f0-4a08-bdab-b16e23127053", "name": "network-vif-unplugged", "status": "completed", "tag": "978785eb-1a68-4a8b-8417-66e0a8b13937"}]} {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:15:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-6a174ea1-e4fa-476b-bf69-49a29ec3005e req-1f3ffa43-35e0-4f8a-a100-d4821918371d service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-6a174ea1-e4fa-476b-bf69-49a29ec3005e req-1f3ffa43-35e0-4f8a-a100-d4821918371d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:33 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [req-6a174ea1-e4fa-476b-bf69-49a29ec3005e req-1f3ffa43-35e0-4f8a-a100-d4821918371d service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:33 user devstack@n-api.service[72494]: INFO nova.api.openstack.compute.server_external_events [req-6a174ea1-e4fa-476b-bf69-49a29ec3005e req-1f3ffa43-35e0-4f8a-a100-d4821918371d service nova] Creating event network-vif-unplugged:978785eb-1a68-4a8b-8417-66e0a8b13937 for instance 72a31d24-b6f0-4a08-bdab-b16e23127053 on user Apr 12 01:15:33 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [req-6a174ea1-e4fa-476b-bf69-49a29ec3005e req-1f3ffa43-35e0-4f8a-a100-d4821918371d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028090 Apr 12 01:15:33 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 387/1157] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:15:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 01:15:35 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [req-4a05464a-85a8-4562-92f3-82787e7ef910 req-4bb0cbc3-27dd-495d-9fee-9f9f87105fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72a31d24-b6f0-4a08-bdab-b16e23127053", "name": "network-vif-deleted", "tag": "978785eb-1a68-4a8b-8417-66e0a8b13937"}]} {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:15:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4a05464a-85a8-4562-92f3-82787e7ef910 req-4bb0cbc3-27dd-495d-9fee-9f9f87105fff service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4a05464a-85a8-4562-92f3-82787e7ef910 req-4bb0cbc3-27dd-495d-9fee-9f9f87105fff service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:35 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [req-4a05464a-85a8-4562-92f3-82787e7ef910 req-4bb0cbc3-27dd-495d-9fee-9f9f87105fff service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:35 user devstack@n-api.service[72496]: INFO nova.api.openstack.compute.server_external_events [req-4a05464a-85a8-4562-92f3-82787e7ef910 req-4bb0cbc3-27dd-495d-9fee-9f9f87105fff service nova] Creating event network-vif-deleted:978785eb-1a68-4a8b-8417-66e0a8b13937 for instance 72a31d24-b6f0-4a08-bdab-b16e23127053 on user Apr 12 01:15:35 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [req-4a05464a-85a8-4562-92f3-82787e7ef910 req-4bb0cbc3-27dd-495d-9fee-9f9f87105fff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037127 Apr 12 01:15:35 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 388/1158] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:15:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:15:35 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [req-eb95c7f4-0f2f-490e-89f5-d72b7531370e req-a32b6439-af5d-407f-8eb1-cf1f31595734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72a31d24-b6f0-4a08-bdab-b16e23127053", "name": "network-vif-plugged", "status": "completed", "tag": "978785eb-1a68-4a8b-8417-66e0a8b13937"}]} {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 01:15:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-eb95c7f4-0f2f-490e-89f5-d72b7531370e req-a32b6439-af5d-407f-8eb1-cf1f31595734 service nova] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:15:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-eb95c7f4-0f2f-490e-89f5-d72b7531370e req-a32b6439-af5d-407f-8eb1-cf1f31595734 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:15:35 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [req-eb95c7f4-0f2f-490e-89f5-d72b7531370e req-a32b6439-af5d-407f-8eb1-cf1f31595734 service nova] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:15:35 user devstack@n-api.service[72495]: INFO nova.api.openstack.compute.server_external_events [req-eb95c7f4-0f2f-490e-89f5-d72b7531370e req-a32b6439-af5d-407f-8eb1-cf1f31595734 service nova] Creating event network-vif-plugged:978785eb-1a68-4a8b-8417-66e0a8b13937 for instance 72a31d24-b6f0-4a08-bdab-b16e23127053 on user Apr 12 01:15:35 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [req-eb95c7f4-0f2f-490e-89f5-d72b7531370e req-a32b6439-af5d-407f-8eb1-cf1f31595734 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035469 Apr 12 01:15:35 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 384/1159] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 01:15:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 01:16:23 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_api:SELECT=12 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:16:23 user devstack@n-api.service[72494]: DEBUG dbcounter [-] [72494] Writing DB stats nova_cell1:SELECT=28 {{(pid=72494) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:16:23 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-ec4d6a89-5896-4813-84c2-53bc4a17c4d2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:16:23 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-ec4d6a89-5896-4813-84c2-53bc4a17c4d2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:16:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ec4d6a89-5896-4813-84c2-53bc4a17c4d2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:16:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ec4d6a89-5896-4813-84c2-53bc4a17c4d2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:16:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ec4d6a89-5896-4813-84c2-53bc4a17c4d2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:16:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ec4d6a89-5896-4813-84c2-53bc4a17c4d2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:16:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ec4d6a89-5896-4813-84c2-53bc4a17c4d2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:16:23 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-ec4d6a89-5896-4813-84c2-53bc4a17c4d2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:16:23 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-ec4d6a89-5896-4813-84c2-53bc4a17c4d2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] HTTP exception thrown: Instance 72a31d24-b6f0-4a08-bdab-b16e23127053 could not be found. Apr 12 01:16:23 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-ec4d6a89-5896-4813-84c2-53bc4a17c4d2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Request method failure captured: Apr 12 01:16:23 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053 HTTP/1.1 Apr 12 01:16:23 user devstack@n-api.service[72494]: Accept: application/json Apr 12 01:16:23 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 01:16:23 user devstack@n-api.service[72494]: Connection: close Apr 12 01:16:23 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 01:16:23 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 01:16:23 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 01:16:23 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 01:16:23 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 01:16:23 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNgNBRnofMS3zjT5ZniCxnE_v79oL5uKe5dh4nKeYWtxF4PVBe2PqHnmQ9DO_od8CVp-AjsXGMhuuXboZqJKtTXVeMiPUEINJQpslnlcepG5aoUwGVUhF4fCcre2xTI0CentdOWP9inZq1TcXh4WIgqn-l34DKJFWcS64n26caFdVdDg Apr 12 01:16:23 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 01:16:23 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 01:16:23 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 01:16:23 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 01:16:23 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 01:16:23 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 01:16:23 user devstack@n-api.service[72494]: X-Project-Id: 8c9933281dea437cbaae1040fa06ff06 Apr 12 01:16:23 user devstack@n-api.service[72494]: X-Project-Name: tempest-AttachVolumeTestJSON-1807582141 Apr 12 01:16:23 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 01:16:23 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 01:16:23 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c9933281dea437cbaae1040fa06ff06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8c9933281dea437cbaae1040fa06ff06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c9933281dea437cbaae1040fa06ff06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 01:16:23 user devstack@n-api.service[72494]: X-Tenant: tempest-AttachVolumeTestJSON-1807582141 Apr 12 01:16:23 user devstack@n-api.service[72494]: X-Tenant-Id: 8c9933281dea437cbaae1040fa06ff06 Apr 12 01:16:23 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1807582141 Apr 12 01:16:23 user devstack@n-api.service[72494]: X-User: tempest-AttachVolumeTestJSON-1807582141-project-member Apr 12 01:16:23 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 01:16:23 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 01:16:23 user devstack@n-api.service[72494]: X-User-Id: bc8bacd3b6194651bc5820c3221ed45e Apr 12 01:16:23 user devstack@n-api.service[72494]: X-User-Name: tempest-AttachVolumeTestJSON-1807582141-project-member Apr 12 01:16:23 user devstack@n-api.service[72494]: method: > Apr 12 01:16:23 user devstack@n-api.service[72494]: exception: Instance 72a31d24-b6f0-4a08-bdab-b16e23127053 could not be found. Apr 12 01:16:23 user devstack@n-api.service[72494]: action_args: {'id': '72a31d24-b6f0-4a08-bdab-b16e23127053'} Apr 12 01:16:23 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72a31d24-b6f0-4a08-bdab-b16e23127053 could not be found. Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72a31d24-b6f0-4a08-bdab-b16e23127053 could not be found. Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72a31d24-b6f0-4a08-bdab-b16e23127053 could not be found. Apr 12 01:16:23 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:16:23 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-ec4d6a89-5896-4813-84c2-53bc4a17c4d2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Returning 404 to user: Instance 72a31d24-b6f0-4a08-bdab-b16e23127053 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 01:16:23 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-ec4d6a89-5896-4813-84c2-53bc4a17c4d2 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053" status: 404 len: 111 microversion: 2.1 time: 0.042136 Apr 12 01:16:23 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 388/1160] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:16:23 2023] GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 01:16:23 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:16:23 user devstack@n-api.service[72496]: DEBUG dbcounter [-] [72496] Writing DB stats nova_cell1:SELECT=42,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=72496) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:16:23 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-cb49780a-d6ac-4bba-bdec-7fabbbd0c27d tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '.version_select at 0x7f7cd47cd120>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:16:23 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-cb49780a-d6ac-4bba-bdec-7fabbbd0c27d tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1597493578" status: 202 len: 0 microversion: 2.1 time: 0.058820 Apr 12 01:16:23 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 389/1161] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 01:16:23 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1597493578 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 01:16:29 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_api:SELECT=14 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:16:29 user devstack@n-api.service[72495]: DEBUG dbcounter [-] [72495] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=72495) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 01:16:29 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-074123db-c3de-4633-b3d1-a74f70380a8f tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:16:29 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-074123db-c3de-4633-b3d1-a74f70380a8f tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:16:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-074123db-c3de-4633-b3d1-a74f70380a8f tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:16:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-074123db-c3de-4633-b3d1-a74f70380a8f tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:16:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-074123db-c3de-4633-b3d1-a74f70380a8f tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:16:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-074123db-c3de-4633-b3d1-a74f70380a8f tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:16:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-074123db-c3de-4633-b3d1-a74f70380a8f tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:16:29 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-074123db-c3de-4633-b3d1-a74f70380a8f tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:16:29 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-074123db-c3de-4633-b3d1-a74f70380a8f tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] HTTP exception thrown: Instance 72a31d24-b6f0-4a08-bdab-b16e23127053 could not be found. Apr 12 01:16:29 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-074123db-c3de-4633-b3d1-a74f70380a8f tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Request method failure captured: Apr 12 01:16:29 user devstack@n-api.service[72495]: request: DELETE /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053 HTTP/1.1 Apr 12 01:16:29 user devstack@n-api.service[72495]: Accept: application/json Apr 12 01:16:29 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 01:16:29 user devstack@n-api.service[72495]: Connection: close Apr 12 01:16:29 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 01:16:29 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 01:16:29 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 01:16:29 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 01:16:29 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 01:16:29 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNgNBRnofMS3zjT5ZniCxnE_v79oL5uKe5dh4nKeYWtxF4PVBe2PqHnmQ9DO_od8CVp-AjsXGMhuuXboZqJKtTXVeMiPUEINJQpslnlcepG5aoUwGVUhF4fCcre2xTI0CentdOWP9inZq1TcXh4WIgqn-l34DKJFWcS64n26caFdVdDg Apr 12 01:16:29 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 01:16:29 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 01:16:29 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 01:16:29 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 01:16:29 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 01:16:29 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 01:16:29 user devstack@n-api.service[72495]: X-Project-Id: 8c9933281dea437cbaae1040fa06ff06 Apr 12 01:16:29 user devstack@n-api.service[72495]: X-Project-Name: tempest-AttachVolumeTestJSON-1807582141 Apr 12 01:16:29 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 01:16:29 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 01:16:29 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c9933281dea437cbaae1040fa06ff06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8c9933281dea437cbaae1040fa06ff06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c9933281dea437cbaae1040fa06ff06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 01:16:29 user devstack@n-api.service[72495]: X-Tenant: tempest-AttachVolumeTestJSON-1807582141 Apr 12 01:16:29 user devstack@n-api.service[72495]: X-Tenant-Id: 8c9933281dea437cbaae1040fa06ff06 Apr 12 01:16:29 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1807582141 Apr 12 01:16:29 user devstack@n-api.service[72495]: X-User: tempest-AttachVolumeTestJSON-1807582141-project-member Apr 12 01:16:29 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 01:16:29 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 01:16:29 user devstack@n-api.service[72495]: X-User-Id: bc8bacd3b6194651bc5820c3221ed45e Apr 12 01:16:29 user devstack@n-api.service[72495]: X-User-Name: tempest-AttachVolumeTestJSON-1807582141-project-member Apr 12 01:16:29 user devstack@n-api.service[72495]: method: > Apr 12 01:16:29 user devstack@n-api.service[72495]: exception: Instance 72a31d24-b6f0-4a08-bdab-b16e23127053 could not be found. Apr 12 01:16:29 user devstack@n-api.service[72495]: action_args: {'id': '72a31d24-b6f0-4a08-bdab-b16e23127053'} Apr 12 01:16:29 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72a31d24-b6f0-4a08-bdab-b16e23127053 could not be found. Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72a31d24-b6f0-4a08-bdab-b16e23127053 could not be found. Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72a31d24-b6f0-4a08-bdab-b16e23127053 could not be found. Apr 12 01:16:29 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:16:29 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-074123db-c3de-4633-b3d1-a74f70380a8f tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Returning 404 to user: Instance 72a31d24-b6f0-4a08-bdab-b16e23127053 could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 01:16:29 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-074123db-c3de-4633-b3d1-a74f70380a8f tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053" status: 404 len: 111 microversion: 2.1 time: 0.100396 Apr 12 01:16:29 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 385/1162] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 01:16:29 2023] DELETE /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 01:16:29 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-1701e421-25e7-4e9b-ab77-c41410da8811 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:16:29 user devstack@n-api.service[72494]: DEBUG nova.compute.api [None req-1701e421-25e7-4e9b-ab77-c41410da8811 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 72a31d24-b6f0-4a08-bdab-b16e23127053] Fetching instance by UUID {{(pid=72494) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:16:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1701e421-25e7-4e9b-ab77-c41410da8811 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:16:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1701e421-25e7-4e9b-ab77-c41410da8811 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:16:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1701e421-25e7-4e9b-ab77-c41410da8811 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:16:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1701e421-25e7-4e9b-ab77-c41410da8811 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:16:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1701e421-25e7-4e9b-ab77-c41410da8811 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:16:29 user devstack@n-api.service[72494]: DEBUG oslo_concurrency.lockutils [None req-1701e421-25e7-4e9b-ab77-c41410da8811 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72494) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:16:29 user devstack@n-api.service[72494]: INFO nova.api.openstack.wsgi [None req-1701e421-25e7-4e9b-ab77-c41410da8811 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] HTTP exception thrown: Instance 72a31d24-b6f0-4a08-bdab-b16e23127053 could not be found. Apr 12 01:16:29 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-1701e421-25e7-4e9b-ab77-c41410da8811 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Request method failure captured: Apr 12 01:16:29 user devstack@n-api.service[72494]: request: GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053 HTTP/1.1 Apr 12 01:16:29 user devstack@n-api.service[72494]: Accept: application/json Apr 12 01:16:29 user devstack@n-api.service[72494]: Accept-Encoding: identity Apr 12 01:16:29 user devstack@n-api.service[72494]: Connection: close Apr 12 01:16:29 user devstack@n-api.service[72494]: Content-Length: 0 Apr 12 01:16:29 user devstack@n-api.service[72494]: Content-Type: application/json Apr 12 01:16:29 user devstack@n-api.service[72494]: Host: 10.0.0.210 Apr 12 01:16:29 user devstack@n-api.service[72494]: Openstack-System-Scope: None Apr 12 01:16:29 user devstack@n-api.service[72494]: User-Agent: python-urllib3/1.26.15 Apr 12 01:16:29 user devstack@n-api.service[72494]: X-Auth-Token: gAAAAABkNgNBRnofMS3zjT5ZniCxnE_v79oL5uKe5dh4nKeYWtxF4PVBe2PqHnmQ9DO_od8CVp-AjsXGMhuuXboZqJKtTXVeMiPUEINJQpslnlcepG5aoUwGVUhF4fCcre2xTI0CentdOWP9inZq1TcXh4WIgqn-l34DKJFWcS64n26caFdVdDg Apr 12 01:16:29 user devstack@n-api.service[72494]: X-Domain-Id: None Apr 12 01:16:29 user devstack@n-api.service[72494]: X-Domain-Name: None Apr 12 01:16:29 user devstack@n-api.service[72494]: X-Identity-Status: Confirmed Apr 12 01:16:29 user devstack@n-api.service[72494]: X-Is-Admin-Project: True Apr 12 01:16:29 user devstack@n-api.service[72494]: X-Project-Domain-Id: default Apr 12 01:16:29 user devstack@n-api.service[72494]: X-Project-Domain-Name: Default Apr 12 01:16:29 user devstack@n-api.service[72494]: X-Project-Id: 8c9933281dea437cbaae1040fa06ff06 Apr 12 01:16:29 user devstack@n-api.service[72494]: X-Project-Name: tempest-AttachVolumeTestJSON-1807582141 Apr 12 01:16:29 user devstack@n-api.service[72494]: X-Role: member,reader Apr 12 01:16:29 user devstack@n-api.service[72494]: X-Roles: member,reader Apr 12 01:16:29 user devstack@n-api.service[72494]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c9933281dea437cbaae1040fa06ff06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8c9933281dea437cbaae1040fa06ff06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c9933281dea437cbaae1040fa06ff06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 01:16:29 user devstack@n-api.service[72494]: X-Tenant: tempest-AttachVolumeTestJSON-1807582141 Apr 12 01:16:29 user devstack@n-api.service[72494]: X-Tenant-Id: 8c9933281dea437cbaae1040fa06ff06 Apr 12 01:16:29 user devstack@n-api.service[72494]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1807582141 Apr 12 01:16:29 user devstack@n-api.service[72494]: X-User: tempest-AttachVolumeTestJSON-1807582141-project-member Apr 12 01:16:29 user devstack@n-api.service[72494]: X-User-Domain-Id: default Apr 12 01:16:29 user devstack@n-api.service[72494]: X-User-Domain-Name: Default Apr 12 01:16:29 user devstack@n-api.service[72494]: X-User-Id: bc8bacd3b6194651bc5820c3221ed45e Apr 12 01:16:29 user devstack@n-api.service[72494]: X-User-Name: tempest-AttachVolumeTestJSON-1807582141-project-member Apr 12 01:16:29 user devstack@n-api.service[72494]: method: > Apr 12 01:16:29 user devstack@n-api.service[72494]: exception: Instance 72a31d24-b6f0-4a08-bdab-b16e23127053 could not be found. Apr 12 01:16:29 user devstack@n-api.service[72494]: action_args: {'id': '72a31d24-b6f0-4a08-bdab-b16e23127053'} Apr 12 01:16:29 user devstack@n-api.service[72494]: {{(pid=72494) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72a31d24-b6f0-4a08-bdab-b16e23127053 could not be found. Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72a31d24-b6f0-4a08-bdab-b16e23127053 could not be found. Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72a31d24-b6f0-4a08-bdab-b16e23127053 could not be found. Apr 12 01:16:29 user devstack@n-api.service[72494]: ERROR nova.api.openstack.wsgi Apr 12 01:16:29 user devstack@n-api.service[72494]: DEBUG nova.api.openstack.wsgi [None req-1701e421-25e7-4e9b-ab77-c41410da8811 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Returning 404 to user: Instance 72a31d24-b6f0-4a08-bdab-b16e23127053 could not be found. {{(pid=72494) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 01:16:29 user devstack@n-api.service[72494]: INFO nova.api.openstack.requestlog [None req-1701e421-25e7-4e9b-ab77-c41410da8811 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053" status: 404 len: 111 microversion: 2.1 time: 0.028933 Apr 12 01:16:29 user devstack@n-api.service[72494]: [pid: 72494|app: 0|req: 389/1163] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:16:29 2023] GET /compute/v2.1/servers/72a31d24-b6f0-4a08-bdab-b16e23127053 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 01:16:31 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-0908d20f-4ba1-47c8-a4b1-39cb50fa63c7 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:16:31 user devstack@n-api.service[72496]: DEBUG nova.compute.api [None req-0908d20f-4ba1-47c8-a4b1-39cb50fa63c7 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Fetching instance by UUID {{(pid=72496) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:16:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0908d20f-4ba1-47c8-a4b1-39cb50fa63c7 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:16:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0908d20f-4ba1-47c8-a4b1-39cb50fa63c7 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:16:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0908d20f-4ba1-47c8-a4b1-39cb50fa63c7 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:16:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0908d20f-4ba1-47c8-a4b1-39cb50fa63c7 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:16:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0908d20f-4ba1-47c8-a4b1-39cb50fa63c7 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:16:31 user devstack@n-api.service[72496]: DEBUG oslo_concurrency.lockutils [None req-0908d20f-4ba1-47c8-a4b1-39cb50fa63c7 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72496) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:16:31 user devstack@n-api.service[72496]: INFO nova.api.openstack.wsgi [None req-0908d20f-4ba1-47c8-a4b1-39cb50fa63c7 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] HTTP exception thrown: Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb could not be found. Apr 12 01:16:31 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-0908d20f-4ba1-47c8-a4b1-39cb50fa63c7 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Request method failure captured: Apr 12 01:16:31 user devstack@n-api.service[72496]: request: DELETE /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb HTTP/1.1 Apr 12 01:16:31 user devstack@n-api.service[72496]: Accept: application/json Apr 12 01:16:31 user devstack@n-api.service[72496]: Accept-Encoding: identity Apr 12 01:16:31 user devstack@n-api.service[72496]: Connection: close Apr 12 01:16:31 user devstack@n-api.service[72496]: Content-Length: 0 Apr 12 01:16:31 user devstack@n-api.service[72496]: Content-Type: application/json Apr 12 01:16:31 user devstack@n-api.service[72496]: Host: 10.0.0.210 Apr 12 01:16:31 user devstack@n-api.service[72496]: Openstack-System-Scope: None Apr 12 01:16:31 user devstack@n-api.service[72496]: User-Agent: python-urllib3/1.26.15 Apr 12 01:16:31 user devstack@n-api.service[72496]: X-Auth-Token: gAAAAABkNgNBRnofMS3zjT5ZniCxnE_v79oL5uKe5dh4nKeYWtxF4PVBe2PqHnmQ9DO_od8CVp-AjsXGMhuuXboZqJKtTXVeMiPUEINJQpslnlcepG5aoUwGVUhF4fCcre2xTI0CentdOWP9inZq1TcXh4WIgqn-l34DKJFWcS64n26caFdVdDg Apr 12 01:16:31 user devstack@n-api.service[72496]: X-Domain-Id: None Apr 12 01:16:31 user devstack@n-api.service[72496]: X-Domain-Name: None Apr 12 01:16:31 user devstack@n-api.service[72496]: X-Identity-Status: Confirmed Apr 12 01:16:31 user devstack@n-api.service[72496]: X-Is-Admin-Project: True Apr 12 01:16:31 user devstack@n-api.service[72496]: X-Project-Domain-Id: default Apr 12 01:16:31 user devstack@n-api.service[72496]: X-Project-Domain-Name: Default Apr 12 01:16:31 user devstack@n-api.service[72496]: X-Project-Id: 8c9933281dea437cbaae1040fa06ff06 Apr 12 01:16:31 user devstack@n-api.service[72496]: X-Project-Name: tempest-AttachVolumeTestJSON-1807582141 Apr 12 01:16:31 user devstack@n-api.service[72496]: X-Role: member,reader Apr 12 01:16:31 user devstack@n-api.service[72496]: X-Roles: member,reader Apr 12 01:16:31 user devstack@n-api.service[72496]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c9933281dea437cbaae1040fa06ff06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8c9933281dea437cbaae1040fa06ff06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c9933281dea437cbaae1040fa06ff06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 01:16:31 user devstack@n-api.service[72496]: X-Tenant: tempest-AttachVolumeTestJSON-1807582141 Apr 12 01:16:31 user devstack@n-api.service[72496]: X-Tenant-Id: 8c9933281dea437cbaae1040fa06ff06 Apr 12 01:16:31 user devstack@n-api.service[72496]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1807582141 Apr 12 01:16:31 user devstack@n-api.service[72496]: X-User: tempest-AttachVolumeTestJSON-1807582141-project-member Apr 12 01:16:31 user devstack@n-api.service[72496]: X-User-Domain-Id: default Apr 12 01:16:31 user devstack@n-api.service[72496]: X-User-Domain-Name: Default Apr 12 01:16:31 user devstack@n-api.service[72496]: X-User-Id: bc8bacd3b6194651bc5820c3221ed45e Apr 12 01:16:31 user devstack@n-api.service[72496]: X-User-Name: tempest-AttachVolumeTestJSON-1807582141-project-member Apr 12 01:16:31 user devstack@n-api.service[72496]: method: > Apr 12 01:16:31 user devstack@n-api.service[72496]: exception: Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb could not be found. Apr 12 01:16:31 user devstack@n-api.service[72496]: action_args: {'id': '9d751ef5-bdbe-4b26-9499-5e17b63de0bb'} Apr 12 01:16:31 user devstack@n-api.service[72496]: {{(pid=72496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb could not be found. Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb could not be found. Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb could not be found. Apr 12 01:16:31 user devstack@n-api.service[72496]: ERROR nova.api.openstack.wsgi Apr 12 01:16:31 user devstack@n-api.service[72496]: DEBUG nova.api.openstack.wsgi [None req-0908d20f-4ba1-47c8-a4b1-39cb50fa63c7 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Returning 404 to user: Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb could not be found. {{(pid=72496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 01:16:31 user devstack@n-api.service[72496]: INFO nova.api.openstack.requestlog [None req-0908d20f-4ba1-47c8-a4b1-39cb50fa63c7 tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb" status: 404 len: 111 microversion: 2.1 time: 0.039475 Apr 12 01:16:31 user devstack@n-api.service[72496]: [pid: 72496|app: 0|req: 390/1164] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 01:16:31 2023] DELETE /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 01:16:31 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-606bb284-dfaa-47b5-a0d8-dbed849bca9a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Calling method '>' {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 01:16:31 user devstack@n-api.service[72495]: DEBUG nova.compute.api [None req-606bb284-dfaa-47b5-a0d8-dbed849bca9a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] [instance: 9d751ef5-bdbe-4b26-9499-5e17b63de0bb] Fetching instance by UUID {{(pid=72495) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 01:16:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-606bb284-dfaa-47b5-a0d8-dbed849bca9a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:16:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-606bb284-dfaa-47b5-a0d8-dbed849bca9a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:16:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-606bb284-dfaa-47b5-a0d8-dbed849bca9a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:16:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-606bb284-dfaa-47b5-a0d8-dbed849bca9a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Acquiring lock "11a19452-896a-4b9c-be96-3c37d500974d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 01:16:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-606bb284-dfaa-47b5-a0d8-dbed849bca9a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 01:16:31 user devstack@n-api.service[72495]: DEBUG oslo_concurrency.lockutils [None req-606bb284-dfaa-47b5-a0d8-dbed849bca9a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Lock "11a19452-896a-4b9c-be96-3c37d500974d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72495) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 01:16:31 user devstack@n-api.service[72495]: INFO nova.api.openstack.wsgi [None req-606bb284-dfaa-47b5-a0d8-dbed849bca9a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] HTTP exception thrown: Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb could not be found. Apr 12 01:16:31 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-606bb284-dfaa-47b5-a0d8-dbed849bca9a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Request method failure captured: Apr 12 01:16:31 user devstack@n-api.service[72495]: request: GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb HTTP/1.1 Apr 12 01:16:31 user devstack@n-api.service[72495]: Accept: application/json Apr 12 01:16:31 user devstack@n-api.service[72495]: Accept-Encoding: identity Apr 12 01:16:31 user devstack@n-api.service[72495]: Connection: close Apr 12 01:16:31 user devstack@n-api.service[72495]: Content-Length: 0 Apr 12 01:16:31 user devstack@n-api.service[72495]: Content-Type: application/json Apr 12 01:16:31 user devstack@n-api.service[72495]: Host: 10.0.0.210 Apr 12 01:16:31 user devstack@n-api.service[72495]: Openstack-System-Scope: None Apr 12 01:16:31 user devstack@n-api.service[72495]: User-Agent: python-urllib3/1.26.15 Apr 12 01:16:31 user devstack@n-api.service[72495]: X-Auth-Token: gAAAAABkNgNBRnofMS3zjT5ZniCxnE_v79oL5uKe5dh4nKeYWtxF4PVBe2PqHnmQ9DO_od8CVp-AjsXGMhuuXboZqJKtTXVeMiPUEINJQpslnlcepG5aoUwGVUhF4fCcre2xTI0CentdOWP9inZq1TcXh4WIgqn-l34DKJFWcS64n26caFdVdDg Apr 12 01:16:31 user devstack@n-api.service[72495]: X-Domain-Id: None Apr 12 01:16:31 user devstack@n-api.service[72495]: X-Domain-Name: None Apr 12 01:16:31 user devstack@n-api.service[72495]: X-Identity-Status: Confirmed Apr 12 01:16:31 user devstack@n-api.service[72495]: X-Is-Admin-Project: True Apr 12 01:16:31 user devstack@n-api.service[72495]: X-Project-Domain-Id: default Apr 12 01:16:31 user devstack@n-api.service[72495]: X-Project-Domain-Name: Default Apr 12 01:16:31 user devstack@n-api.service[72495]: X-Project-Id: 8c9933281dea437cbaae1040fa06ff06 Apr 12 01:16:31 user devstack@n-api.service[72495]: X-Project-Name: tempest-AttachVolumeTestJSON-1807582141 Apr 12 01:16:31 user devstack@n-api.service[72495]: X-Role: member,reader Apr 12 01:16:31 user devstack@n-api.service[72495]: X-Roles: member,reader Apr 12 01:16:31 user devstack@n-api.service[72495]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c9933281dea437cbaae1040fa06ff06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8c9933281dea437cbaae1040fa06ff06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c9933281dea437cbaae1040fa06ff06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 12 01:16:31 user devstack@n-api.service[72495]: X-Tenant: tempest-AttachVolumeTestJSON-1807582141 Apr 12 01:16:31 user devstack@n-api.service[72495]: X-Tenant-Id: 8c9933281dea437cbaae1040fa06ff06 Apr 12 01:16:31 user devstack@n-api.service[72495]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1807582141 Apr 12 01:16:31 user devstack@n-api.service[72495]: X-User: tempest-AttachVolumeTestJSON-1807582141-project-member Apr 12 01:16:31 user devstack@n-api.service[72495]: X-User-Domain-Id: default Apr 12 01:16:31 user devstack@n-api.service[72495]: X-User-Domain-Name: Default Apr 12 01:16:31 user devstack@n-api.service[72495]: X-User-Id: bc8bacd3b6194651bc5820c3221ed45e Apr 12 01:16:31 user devstack@n-api.service[72495]: X-User-Name: tempest-AttachVolumeTestJSON-1807582141-project-member Apr 12 01:16:31 user devstack@n-api.service[72495]: method: > Apr 12 01:16:31 user devstack@n-api.service[72495]: exception: Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb could not be found. Apr 12 01:16:31 user devstack@n-api.service[72495]: action_args: {'id': '9d751ef5-bdbe-4b26-9499-5e17b63de0bb'} Apr 12 01:16:31 user devstack@n-api.service[72495]: {{(pid=72495) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb could not be found. Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb could not be found. Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb could not be found. Apr 12 01:16:31 user devstack@n-api.service[72495]: ERROR nova.api.openstack.wsgi Apr 12 01:16:31 user devstack@n-api.service[72495]: DEBUG nova.api.openstack.wsgi [None req-606bb284-dfaa-47b5-a0d8-dbed849bca9a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] Returning 404 to user: Instance 9d751ef5-bdbe-4b26-9499-5e17b63de0bb could not be found. {{(pid=72495) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 01:16:31 user devstack@n-api.service[72495]: INFO nova.api.openstack.requestlog [None req-606bb284-dfaa-47b5-a0d8-dbed849bca9a tempest-AttachVolumeTestJSON-1807582141 tempest-AttachVolumeTestJSON-1807582141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb" status: 404 len: 111 microversion: 2.1 time: 0.031842 Apr 12 01:16:31 user devstack@n-api.service[72495]: [pid: 72495|app: 0|req: 386/1165] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 01:16:31 2023] GET /compute/v2.1/servers/9d751ef5-bdbe-4b26-9499-5e17b63de0bb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)